-- Logs begin at Mon 2022-02-21 08:44:29 UTC, end at Mon 2022-02-21 09:54:00 UTC. -- Feb 21 09:17:02.271647 dv-cinder-778193-19-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 21 09:17:02.281871 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 09:17:02 2022] *** Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: nodename: dv-cinder-778193-19-iscsi Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: machine: x86_64 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: clock source: unix Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: pcre jit disabled Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: detected number of CPU cores: 4 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: current working directory: / Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: detected binary path: /usr/bin/uwsgi-core Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: your processes number limit is 47680 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: your memory page size is 4096 bytes Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: detected max file descriptor number: 2048 Feb 21 09:17:02.284011 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: lock engine: pthread robust mutexes Feb 21 09:17:02.284723 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: thunder lock: enabled Feb 21 09:17:02.284723 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 21 09:17:02.284723 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 09:17:02.330393 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: Python main interpreter initialized at 0x55ad338809c0 Feb 21 09:17:02.330393 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: python threads support enabled Feb 21 09:17:02.330393 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: your server socket listen backlog is limited to 100 connections Feb 21 09:17:02.330393 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: your mercy for graceful operations on workers is 90 seconds Feb 21 09:17:02.330718 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 09:17:02.330812 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: *** Operational MODE: preforking *** Feb 21 09:17:02.331085 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: *** uWSGI is running in multiple interpreter mode *** Feb 21 09:17:02.331085 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: spawned uWSGI master process (pid: 79593) Feb 21 09:17:02.331279 dv-cinder-778193-19-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 21 09:17:02.332384 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: spawned uWSGI worker 1 (pid: 79600, cores: 1) Feb 21 09:17:02.332384 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: spawned uWSGI worker 2 (pid: 79601, cores: 1) Feb 21 09:17:02.332384 dv-cinder-778193-19-iscsi devstack@keystone.service[79593]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 09:17:08.105685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:17:08.105685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: from cryptography.utils import int_from_bytes Feb 21 09:17:08.106478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:17:08.106478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: from cryptography.utils import int_from_bytes Feb 21 09:17:08.106909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:17:08.106909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: from cryptography.utils import int_from_bytes Feb 21 09:17:08.107037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:17:08.107037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: from cryptography.utils import int_from_bytes Feb 21 09:17:08.172376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 09:17:08.172545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 09:17:08.172637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 09:17:08.172730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 09:17:08.172810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] command line args: [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 09:17:08.172896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] command line args: [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 09:17:08.173002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 09:17:08.173088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 09:17:08.173166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ================================================================================ {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 09:17:08.173244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ================================================================================ {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 09:17:08.173425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] admin_token = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.173516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] admin_token = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.173674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] config_dir = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.173761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] config_dir = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.173870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.173956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] config_source = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] config_source = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] debug = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] debug = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.174857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.175924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_config_append = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_config_append = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_dir = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_dir = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_file = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.176937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_file = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.177940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.178922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.179774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] publish_errors = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] publish_errors = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.180956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] standard_threads = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] standard_threads = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.181979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] use_journal = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] use_journal = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] use_json = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] use_json = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] use_stderr = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.182954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] use_stderr = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.183016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] use_syslog = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.183091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] use_syslog = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.183200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.183285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:17:08.190953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.191965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.192968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.193925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.194932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.195956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.196960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.197964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.198949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.199967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.200994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.201999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.202966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.203922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.204968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.205912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.206987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.207924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.external = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.208971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.password = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] auth.token = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.209950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.external = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.210899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.password = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] auth.token = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.211883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.212860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.213980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.214970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.215976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.216981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.217937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.218891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.219925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.220852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.221986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.222953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.223921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.224948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.225887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.226998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.227965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.228938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.229903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.230895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.231856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.232845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.233991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.234969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.235926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.236970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.237777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.238956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.239880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.240918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.241844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] role.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.242984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] role.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] role.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.243937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] role.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.244885 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.245873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.246942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.247892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.248500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.248713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.248798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.248937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.249958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.250925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.251878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.252986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.253890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.254927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.255965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.connection = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.256878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.connection = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.257980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.258920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.259959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 09:17:08.260473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.260928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.261160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:17:08.261328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 09:17:08.291499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.291667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.291748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.291822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.291956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.292147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.300552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.300648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.329888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.330117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.330556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.330793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.384559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.384701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.434327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.434456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.434559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.434641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.500974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.501907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.502036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.502120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.502253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.527870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.528751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.539838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.540088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.553946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.554595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:17:08.571929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.572141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:17:08.572453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.572566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.572682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:17:08.572784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:17:08.572988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:17:08.573393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.573999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.574153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.574416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.584430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.584704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.584973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.585055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.585253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.585337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.585555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.585839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.593210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.593860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.596646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.596929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.597202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.597284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.597481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.597563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.597757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.597839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.598896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.599895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.626392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.626745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.627989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.628266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.628349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.628621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.633379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.633654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.633768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.633930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.634047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.634332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.641455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.641693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.641905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.642190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.646052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.646339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.646568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.646666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.646859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.646943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.647963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.648056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.648231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.648501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.666088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.666364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.666885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.667163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.671416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.672292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.675021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.675332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.675852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.676148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.680330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.681175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.683875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.684732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.688025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.688322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.688604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.688855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.688957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.689154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.689247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.689434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.689534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.689723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.690014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.690292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.708314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.708595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.708858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.709072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.709165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.709360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.709628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.709894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.717359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.718147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.719103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.719413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.719835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.720112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.722372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.722659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.723059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.723149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.723370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.723464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.723733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.723826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.724048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.724339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.737320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.737598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.737881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.737973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.738158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.738985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.739078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.739268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.739572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.757781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.759384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.760964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.762574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.764239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.766044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.766151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.767711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.871190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.871521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.871679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.871833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.871967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.872252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.879023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.879518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.880630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.881075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.883756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.884844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.885116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.893902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.894143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.894393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.894484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.894679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.894963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.902116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.902397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.902679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.902827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:17:08.902957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.903898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.904075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.904160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.904861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.904946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.905849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.906864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:17:08.943689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad338809c0 pid: 79601 (default app) Feb 21 09:17:08.943983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad338809c0 pid: 79600 (default app) Feb 21 09:17:08.947061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee324-1c9f-4dfb-afee-0dc1603c15cc None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:08.947460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee324-1c9f-4dfb-afee-0dc1603c15cc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:08.947745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbee324-1c9f-4dfb-afee-0dc1603c15cc None None] PATH_INFO: `/v3` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:08.951968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Mon Feb 21 09:17:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:18.301376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:18.301914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:18.301914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:18.306978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:18.312660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:18.313071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:18.313230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:18.344092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG oslo_db.sqlalchemy.engines [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 09:17:18.525840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG passlib.handlers.bcrypt [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 09:17:18.526266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG passlib.handlers.bcrypt [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 09:17:18.581593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:18.583182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:18.761581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:18.909961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:18.943778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG oslo_db.sqlalchemy.engines [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 09:17:19.071923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd53bb-24d5-418a-b3cb-890069f56342 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:19.076260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:19.076920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:19.077209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:19.077489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:19.085452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:19.135467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.common.rbac_enforcer.enforcer [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 09:17:19.135815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61652d23-ef8e-488c-9de4-1351c4eb1b90 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:19.145303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:19.151347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:19.165447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df88d-b397-4dd4-89e4-a85a8e62b8db None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:19.169817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:19.171457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:19.171747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:19.172024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] PATH_INFO: `/v3/projects/c3f01046c2f74fba94104e65299e171f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:19.173544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3f01046c2f74fba94104e65299e171f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:19.225473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 09:17:19.225827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fa518-7fa1-4364-a92d-50b31b121397 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:19.230508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:19 2022] GET /identity/v3/projects/c3f01046c2f74fba94104e65299e171f => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:21.474001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab2cc-c4df-41c3-bd08-764f368a5cf1 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:21.474530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab2cc-c4df-41c3-bd08-764f368a5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:21.474530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ab2cc-c4df-41c3-bd08-764f368a5cf1 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:21.479050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:21.485053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:21.485415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:21.485626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:21.504073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:21.505624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:21.513553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:21.536761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ab2cc-c4df-41c3-bd08-764f368a5cf1 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:21.549590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ab2cc-c4df-41c3-bd08-764f368a5cf1 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:21.554127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:21.554762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:21.555049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:21.555353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:21.563017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:21.564816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48506762-3fb6-4878-944a-757b7e7fdb79 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:21.573270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:17:21.578561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:21.587553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832ac41-e95c-46f7-8094-e22023512c67 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:21.592491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:21.593353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:21.593640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:21.593918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:21.595321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:21.597180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5709b-7da8-4fc2-8514-1de1afeb88a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:21.598728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:21 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:23.956209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0701-4de4-489e-8662-f59e5ebe22a3 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:23.956744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0701-4de4-489e-8662-f59e5ebe22a3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:23.956828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0ac1-5dde-4c98-9c46-d7da2f0800c2 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:23.957165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0701-4de4-489e-8662-f59e5ebe22a3 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:23.957235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0ac1-5dde-4c98-9c46-d7da2f0800c2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:23.957235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0ac1-5dde-4c98-9c46-d7da2f0800c2 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:23.958499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:23.959131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:23.963606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:23.963897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:23.964176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:23.964281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:23.964551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:23.964837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:23.982145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:23.983373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:23.990958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 7/12] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:24.005673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG passlib.handlers.bcrypt [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79600) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 09:17:24.006092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG passlib.handlers.bcrypt [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79600) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 09:17:24.014563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.024040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293166d-7ad2-477a-a521-df8c8f2c2f17 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.028464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.029239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.029528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.029807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.042481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:24.049386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:24.050539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 8/13] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:17:24.052827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:24.054418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:24.055926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.065606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc15ec-5fc8-4bce-a7f0-14ec099ba720 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.069978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.070596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.070885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.071162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.071955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:24.072259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.074034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:24.074034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:24.074034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:24.074926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.077636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 6/14] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:24.088447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 9/15] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:24.093561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.099688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.103219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14ba91-4c1a-4b43-bebe-51ff583fadac None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.108202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.109381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.109470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1f65-9771-4f6c-8c06-d68cc5a5e2c9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.109671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.109958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.111583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.113452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.113773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.114391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.114678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.114957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.115036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 7/16] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:24.119982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.122767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.125201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.129571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f069b-9df4-4b6d-9555-ef709af07392 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.134173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 10/17] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:17:24.134294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.134910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.135198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.135508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.136709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.138417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.139471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.140225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 8/18] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:24.145619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:24.148212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf9840-c112-491c-b240-afef4a4ff9a7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.152663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.153416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.153703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.153978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.154660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fa7f-0aad-4841-9bcd-e90c26f60b19 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:24.155184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.156893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd84e6-7bf1-4e70-9d17-a04887536cb7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.158419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 11/19] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:24.160050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:24.160660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:24.160946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:24.161227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:24.162054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.domain.id=default, user.id=1dd6f1c3379444b8bbd64274c9643ace) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:24.162367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:24.164188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:24.164188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:24.164188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:24.165380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be0129-1b52-4ab0-9fc3-41800c82598b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:24.176221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 9/20] 10.222.0.65 () {56 vars in 1343 bytes} [Mon Feb 21 09:17:24 2022] GET /identity/v3/role_assignments?user.id=1dd6f1c3379444b8bbd64274c9643ace&scope.domain.id=default&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:26.962966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a139-06fb-4fb4-87e8-4026201cc3bf None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:26.963530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a139-06fb-4fb4-87e8-4026201cc3bf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:26.963530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a139-06fb-4fb4-87e8-4026201cc3bf None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:26.965601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 12/21] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:26.971674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6013153-d77e-4720-b372-afd1b568825f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:26.972089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6013153-d77e-4720-b372-afd1b568825f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:26.972250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6013153-d77e-4720-b372-afd1b568825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:26.998161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b6013153-d77e-4720-b372-afd1b568825f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:26.999404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b6013153-d77e-4720-b372-afd1b568825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:27.010709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 10/22] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:27.041520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a139-06fb-4fb4-87e8-4026201cc3bf None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.060771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a139-06fb-4fb4-87e8-4026201cc3bf None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.065591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.066430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.066860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.067286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.068220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.069374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:27.069374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:27.069374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:27.070555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.331960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72de2c-8296-4b80-ad0b-16560c76e050 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.332674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72de2c-8296-4b80-ad0b-16560c76e050 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.332949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72de2c-8296-4b80-ad0b-16560c76e050 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.335236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 11/23] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:27.336648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ab92-90cc-4c7b-89e8-cc0bf47332ff None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.337138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ab92-90cc-4c7b-89e8-cc0bf47332ff None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.337640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ab92-90cc-4c7b-89e8-cc0bf47332ff None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.339910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 12/24] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:27.341192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204625-03b1-421d-b7e2-2203dd81b551 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.341819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204625-03b1-421d-b7e2-2203dd81b551 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.342924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204625-03b1-421d-b7e2-2203dd81b551 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.344984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 13/25] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:27.346262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65b61-41b3-49ff-bb9d-22dbad644414 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.346746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65b61-41b3-49ff-bb9d-22dbad644414 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.347219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65b61-41b3-49ff-bb9d-22dbad644414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.367677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-56b65b61-41b3-49ff-bb9d-22dbad644414 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:27.369161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-56b65b61-41b3-49ff-bb9d-22dbad644414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:27.377558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:27.379022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e046e-6885-4acf-99c3-d9a6a55fbab9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.379540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e046e-6885-4acf-99c3-d9a6a55fbab9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.380018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e046e-6885-4acf-99c3-d9a6a55fbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.398031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6c8e046e-6885-4acf-99c3-d9a6a55fbab9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:27.399499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6c8e046e-6885-4acf-99c3-d9a6a55fbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:27.408296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 15/27] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:27.409770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.410261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.410737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.428311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:27.429747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:27.439609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 13/28] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/roles => generated 219 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:27.441989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.443456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 16/29] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:27.452759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.463237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576f45d-83a1-48e0-aa9d-e6a866a2fa58 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.469005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6605a5-a65d-4334-a346-079b52b7cd77 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.477100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.478299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.478807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.479283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.480284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.481525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:27.481525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:27.481525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:27.482627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.483030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.483472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.483764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.484041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.516405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:27.524225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:27.526223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 14/30] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:27.527212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.541688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92d8d-4da5-46d1-8a2d-21f0b4da2f2e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.546530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.547398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.547688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.547972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.559492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.562090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.581887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:17:27.583761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 15/31] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:27.584605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.595099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880d4ee-2c50-4141-83ec-03ae56144506 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.600631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.601311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.601599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.601876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.602700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:27.603014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.607428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.627363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 16/32] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:27.627363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.648296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97c77-75b3-4c0f-8d20-870aa7ec56a6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.658994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.660558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.661930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.662423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.663672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:27.665216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.666335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:27.666335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:27.666335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:27.667470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.692261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 17/33] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:27.693127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.709543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d9a64-b02a-4843-a5b6-1e166ec9e588 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.721540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.722433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.722725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.723005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.724462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.726304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.731126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 18/34] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:27.731126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.743567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b6146-b429-4945-a52b-3bd43107c9ed admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.748137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.748800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.749092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.749373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.750095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.751112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:27.751112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:27.751112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:27.752387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6dee8-b973-4e82-a113-2943e160e886 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.760907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 17/35] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:27.762213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.774334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746035f-102d-4ae0-bb8e-10d50bdeef17 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.784810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.788792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.788792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.788792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.788792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.790490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.792910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 18/36] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:27.799675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:27.812365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c103b1-6bf4-4a6f-bcd9-1f4e0b570fa0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:27.817685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:27.822732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:27.822732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:27.822732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] PATH_INFO: `/v3/domains/default/users/1dd6f1c3379444b8bbd64274c9643ace/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:27.822732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1dd6f1c3379444b8bbd64274c9643ace, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:27.823775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:27.823775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:27.823775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:27.826565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39aa35b-5041-4579-aa66-c9734fe35349 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:27.881783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 19/37] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:17:27 2022] POST /identity/v3/projects => generated 301 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:27.909066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 19/38] 10.222.0.65 () {58 vars in 1382 bytes} [Mon Feb 21 09:17:27 2022] PUT /identity/v3/domains/default/users/1dd6f1c3379444b8bbd64274c9643ace/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:17:28.295358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b67a-b08e-4dd6-9a26-f61b7afec456 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.295856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b67a-b08e-4dd6-9a26-f61b7afec456 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.295856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b67a-b08e-4dd6-9a26-f61b7afec456 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.297770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 20/39] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:28.303155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32187-dcc2-446e-acc1-4a9eac3daf8c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.303560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32187-dcc2-446e-acc1-4a9eac3daf8c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.303748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f32187-dcc2-446e-acc1-4a9eac3daf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.322301 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-64f32187-dcc2-446e-acc1-4a9eac3daf8c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:28.323844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-64f32187-dcc2-446e-acc1-4a9eac3daf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:28.398726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 20/40] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:28.421284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b67a-b08e-4dd6-9a26-f61b7afec456 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:28.433235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b67a-b08e-4dd6-9a26-f61b7afec456 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:28.437979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:28.438633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.438921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.439200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.439996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:28.441633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:28.523141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45c61-7610-4aab-a0d7-4da47e28b89d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.523592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45c61-7610-4aab-a0d7-4da47e28b89d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.523883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45c61-7610-4aab-a0d7-4da47e28b89d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.525721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 21/41] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:28.530489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.530783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.531064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.541228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 21/42] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:17:28 2022] POST /identity/v3/roles => generated 223 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:28.549755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:28.550935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:28.559089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 22/43] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:28.583188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:28.593258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c22c2-fc0a-48f2-926c-38e4dfcfa1dc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:28.597871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:28.598719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.599008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.599286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.600581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:28.602351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402adcc-65be-499d-bb75-01f5fcf95db3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:28.604264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:28.610343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:28.619826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a9b19-0278-4224-a8fa-bafe01d25ae5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:28.624967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:28.625652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:28.625938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:28.626220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:28.626961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:28.628041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:28.628041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:28.628041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:28.629277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2d33c-2590-4f8c-8791-ef88cb700f4e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:28.726160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:17:28 2022] POST /identity/v3/projects => generated 312 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:30.307660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbae99-42f5-4d7c-930e-28160cfba1a1 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.308198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbae99-42f5-4d7c-930e-28160cfba1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.308198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbae99-42f5-4d7c-930e-28160cfba1a1 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.309996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 23/46] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:30.315211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.315627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.315802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.333880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:30.335064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:30.389868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 24/47] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:30.413688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbae99-42f5-4d7c-930e-28160cfba1a1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:30.425880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbae99-42f5-4d7c-930e-28160cfba1a1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:30.430133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:30.430910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.431201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.431519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.442090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:30.449027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:30.450198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 24/48] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:30.456355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:30.465347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e564a-55f3-4100-8cc4-e2379cde9678 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:30.469774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:30.470435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.470726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.471010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.471803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:30.472117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:30.473128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:30.473128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:30.473128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:30.474054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:30.487878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:30.492988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:30.503651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae556f8-a148-4359-8de3-86899f9fcc7f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:30.508038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:30.508929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.509217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.509493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.510700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:30.512575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:30.514768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 25/50] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:30 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:30.520274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:30.530078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57947b-4e99-48e1-bb39-8d489579cdb8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:30.534488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:30.535273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.535595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.535880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.537068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:30.538791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ce2a0-9519-497b-af3d-f04af1d7e17c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:30.540401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 26/51] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:30.545745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:30.555353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bbf97-462d-4f83-bfc3-47666a15cc26 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:30.559803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:30.560894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:30.561190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:30.561472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:30.562305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.domain.id=default, user.id=1dd6f1c3379444b8bbd64274c9643ace) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:30.562624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:30.563667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:30.563667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:30.563667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:30.564846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaa52-7ab6-47a0-86de-194d6813e284 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:30.574379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1343 bytes} [Mon Feb 21 09:17:30 2022] GET /identity/v3/role_assignments?user.id=1dd6f1c3379444b8bbd64274c9643ace&scope.domain.id=default&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:31.081209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca537-5b3c-4eab-b027-61709571093c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:31.081505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca537-5b3c-4eab-b027-61709571093c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:31.081793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca537-5b3c-4eab-b027-61709571093c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:31.083633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 27/53] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:31.088765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:31.089068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:31.089359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:31.107120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:31.109193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:31.116837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 27/54] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:31.145912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ca537-5b3c-4eab-b027-61709571093c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:31.160756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ca537-5b3c-4eab-b027-61709571093c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:31.165167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:31.165952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:31.166239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:31.166518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:31.167717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:31.169468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32952212-0a40-46ab-99d1-aeaa8a9dac7e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:31.175690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:31.177443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:31.187910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751c821-8834-417d-9b8c-7b9b7a79be4f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:31.192463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:31.193118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:31.193411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:31.193702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:31.194417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:31.196389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed4c0a-0d50-47d4-b57e-f2deb97aac95 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:31.272103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 28/56] 10.222.0.65 () {60 vars in 1161 bytes} [Mon Feb 21 09:17:31 2022] POST /identity/v3/projects => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:33.550695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003b4c-7937-4f35-a440-a2945b00d093 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:33.551206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003b4c-7937-4f35-a440-a2945b00d093 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:33.551287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78003b4c-7937-4f35-a440-a2945b00d093 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:33.553023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 29/57] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:33.558071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:33.558475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:33.558633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:33.575904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:33.577109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:33.631455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 29/58] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:33.656122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003b4c-7937-4f35-a440-a2945b00d093 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:33.667832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78003b4c-7937-4f35-a440-a2945b00d093 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:33.672676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:33.673447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:33.673732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:33.674008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:33.675159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:33.676881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8edb0-3c3b-4ca2-9a92-275542958741 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:33.678410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 30/59] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:33.683160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:33.691771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53ca1-0d51-4815-a636-0491df196299 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:33.696111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:33.696753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:33.697038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:33.697316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:33.698013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:33.699016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:33.699016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:33.699016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:33.700271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d14ae-7a50-43af-9cd6-16cab1fe17b3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:33.815230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 30/60] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:33 2022] POST /identity/v3/users => generated 275 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:37.037538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4b34-80c8-4808-bffc-a2d72f811f0e None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.038503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4b34-80c8-4808-bffc-a2d72f811f0e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.038941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4b34-80c8-4808-bffc-a2d72f811f0e None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.041348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 31/61] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:37.067551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.068485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.068963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.092354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:37.093878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:37.105124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 31/62] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:37.134248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4b34-80c8-4808-bffc-a2d72f811f0e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.151017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4b34-80c8-4808-bffc-a2d72f811f0e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.155822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.156839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.157327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.157793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.180278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:37.188313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:37.190040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 32/63] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:37.195353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.204857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839082-ec23-43f0-8100-561b0a7722c6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.214928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.215906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.216410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.217432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.218404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:37.218919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.220787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.230102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 32/64] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.235817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.248496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47b2-3e88-4125-8984-2b2c3193c6f9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.253437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.254552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.255055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.255578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.280410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.282629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.284550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 33/65] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.289917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.304571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6014be6-9699-4be3-b0e1-9394549563af admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.321416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.322090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.322378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.322660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.339664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.342063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.357633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 33/66] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:37.363606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.377893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d564ea-67a0-4871-a363-0dc39a2501e1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.393244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.394130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.394425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.394710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.400315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.402468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd69aa3-6948-484f-b0a5-b955f659590e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.405204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 34/67] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.410865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.418922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adb8d-a778-4afd-9fcd-29bd7743bcb8 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.419253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adb8d-a778-4afd-9fcd-29bd7743bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.419516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5adb8d-a778-4afd-9fcd-29bd7743bcb8 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.422350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 35/68] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:37.427403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.427925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.428404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.429582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67f86d-c84a-4736-8ae0-e8bf90a697fd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.440037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.440710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.441000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.441283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.442130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:37.442446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.444372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.449317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:37.450754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:37.455647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.468178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 36/70] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:37.518155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.533324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6a2d-629c-4696-bffd-f12588ff19b8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.539557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.540418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.540652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.540928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.560907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:37.567888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:37.570031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:37.580231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.590098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab82d86-3bd7-4984-a0af-35cbeeb845fd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.599693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.600415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.600706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.600992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.601787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:37.602103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.603860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.619341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 37/72] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.626092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.641002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2b64-7781-499b-81a3-887e77394d1b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.647828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.648727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.649022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.649308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.656519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.658459 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.660243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.666182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.680799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a0464-1a45-40bf-ba37-ac7f5734351c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.691209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.691926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.692216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.692501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.702202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.704088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.713110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 38/74] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:37.718866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.732887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21156b-022d-4ea3-acd6-728d33176868 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.740390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.741479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.741951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.742414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.743951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.746275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02333-71d1-464f-b27e-5126fdd6f69f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.748790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.754678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.764135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604c211-dde9-46c8-bae4-5fbff621fea4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.771330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.772247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.772722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.773181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.774191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=1dd6f1c3379444b8bbd64274c9643ace) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:37.774679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:37.776791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4542800-fee0-461e-b4d5-1df42eb6fae2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:37.787474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/role_assignments?user.id=1dd6f1c3379444b8bbd64274c9643ace&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:37.807130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d20c2-d648-4a12-a3f0-2181b073d67c None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.807731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d20c2-d648-4a12-a3f0-2181b073d67c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.808198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d20c2-d648-4a12-a3f0-2181b073d67c None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.810209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 38/77] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:37.816540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.817089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.817564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.839794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:37.841330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:37.849021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3f87-c701-4360-a95f-494ae64e4beb None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.849757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3f87-c701-4360-a95f-494ae64e4beb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.850250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c3f87-c701-4360-a95f-494ae64e4beb None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.852723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 39/78] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:37.856967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 40/79] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:37.859821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.860324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.860796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.891900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.897265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:37.899695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:37.905744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069654a-68e3-40b6-beeb-6ca05613ed9a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.915477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 40/80] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:37.916145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.916979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.917271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.917647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.938436 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:37.942071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.952325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc63a9-1340-4b10-bdb4-fef8269cfdad None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.958367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:37.959691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 41/81] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:17:37.960796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:37.961938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:37.962427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:37.962951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:37.971323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:37.987855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:37.991411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314cbe-6a0a-4357-819a-b3a7628ec5c0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:37.997173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-5de1756e-4fd9-4078-b70c-382569791808 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:37.999037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 41/82] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:17:38.000335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11574-74df-4a22-8497-674f56a3b68a None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.000457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.000677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11574-74df-4a22-8497-674f56a3b68a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.000903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11574-74df-4a22-8497-674f56a3b68a None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.001058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.001352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.001632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.002446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:38.002759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.002856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 42/83] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:38.005129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc9e9-9d94-47ef-8c01-3cae0f3cf13d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.007607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc11574-74df-4a22-8497-674f56a3b68a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.016897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 42/84] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:38.018359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.018746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.019032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.025612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc11574-74df-4a22-8497-674f56a3b68a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.033065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.033943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.034320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.034709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.035655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:38.036076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.038023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.038354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:38.039628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:38.048251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 43/85] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:38.049275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.058150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 43/86] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.060026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552aa08-cb58-4be0-9dcd-8b61dd3b9e82 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.064864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.065466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.066405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.066707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.066989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.068441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.070766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.072909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 44/87] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.078879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.079871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8e1e-ddf8-4096-bbe8-40f60b6e6ade admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.087147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.088067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.088353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.088624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.090151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.090490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7266b-dbfa-45a2-b203-4082ef48d204 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.093123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.094862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 44/88] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:38.096782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.097429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.097716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.097999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.100320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.110407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.111048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9b9d-5244-444f-b8f8-ea862ec3a746 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.112237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.115652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.116474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.116768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.117043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.118248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.120065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.125774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 45/89] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.125774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.126105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 45/90] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:38.127138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.132581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c145-c040-4aa0-9f9b-0df15350f2e6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.141601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.142226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.142556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.142833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.142943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82248a-9849-4739-a224-061ea91475d3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.147986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.149198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.150148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.150640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.151861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.152542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.153667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.155637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.157543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 46/91] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.158842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.164421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 46/92] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:38.165294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.171229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a6113-3be3-42fe-92ba-16a6cea2cec9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.176633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.177662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.178235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.178687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.179598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.180254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac2783-f475-4d05-9482-65424d114748 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.181079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:38.181079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:17:38.181079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:17:38.182738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4138c-c9d6-4198-97f0-641fd1d11548 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.185252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.186022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.186426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.186771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.187772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:38.188207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.190275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.196296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 47/93] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.197036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.211374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8af32-b734-4674-af25-eed577d52ea1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.216208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] PATH_INFO: `/v3/projects/ad93756c5b4c451484dc25dbc172c250` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] RBAC: Authorizing `identity:get_project(project_id=ad93756c5b4c451484dc25dbc172c250)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.226707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 48/94] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/projects/ad93756c5b4c451484dc25dbc172c250 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:38.230467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:38.242406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b8881-7670-43d2-82e5-dc6664487060 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:38.247673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:38.249118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:38.249465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:38.249747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:38.250744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=ad93756c5b4c451484dc25dbc172c250, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:38.251066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:38.253139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8056a9-89b5-48ff-aac0-5a6ed0287d7a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:38.260246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 49/95] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:38 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=ad93756c5b4c451484dc25dbc172c250&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:38.291081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 47/96] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:38 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:40.313114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca93ce-280f-42b4-a0d7-65a9d899620d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.313827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca93ce-280f-42b4-a0d7-65a9d899620d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.313827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca93ce-280f-42b4-a0d7-65a9d899620d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.315592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 50/97] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:40.321108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.321600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.321767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.343200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:40.344441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:40.352370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 48/98] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:40.387848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca93ce-280f-42b4-a0d7-65a9d899620d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:40.405672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca93ce-280f-42b4-a0d7-65a9d899620d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:40.409980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:40.410767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.411052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.411347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.428260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:40.435136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:40.436583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 51/99] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:40.442642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:40.454671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115cba6-4243-4087-a3d7-d622f929e551 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:40.463363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:40.464041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.464325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.464604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.465353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:40.465662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:40.468016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:40.483557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 49/100] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:40.489303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:40.505724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c1394-3d20-4341-9841-dfc0c48dd580 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:40.510166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:40.511045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.511348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.511634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.512835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:40.515015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:40.516895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 52/101] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:40 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:40.522580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:40.536320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ad939-5da0-4e5c-8ccd-207f1e067399 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:40.543482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:40.544340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.544700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.545486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.552086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:40.554178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fc2f2-8230-4a4c-b3f5-daabdaf55784 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:40.555949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 50/102] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:40 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:40.562012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:40.578090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316d293-79f7-4a29-a53e-ecbcd5c08ca3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:40.582637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:40.583597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.583883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.584141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/c1751cf86da943269cce86604e4cfe9e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.586388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, user_id=c1751cf86da943269cce86604e4cfe9e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:40.592278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:17:40.592278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:17:40.592278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:17:40.594319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4564e-bc5c-4c53-b1be-dfd49791fddc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:40.660855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 53/103] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:40 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/c1751cf86da943269cce86604e4cfe9e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:17:40.972928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df210-54b1-4c05-89ff-708712a11533 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.973124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df210-54b1-4c05-89ff-708712a11533 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.973413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df210-54b1-4c05-89ff-708712a11533 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:40.975288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 51/104] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:40.980808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:40.981104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:40.981385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.004306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:41.005508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:41.070954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 54/105] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:41.116754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df210-54b1-4c05-89ff-708712a11533 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.133502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df210-54b1-4c05-89ff-708712a11533 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.139949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.152198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.152198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.152198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.156254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:41.163064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-576c79c1-be51-4f85-9bfc-c2ea596e7b1e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:41.164493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 52/106] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:41.170949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.180069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66678720-9fed-4ca7-aa03-293953c028d0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.186193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.186875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.187164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.187466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.188233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:41.188542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.188889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d840-e8a3-4cd7-8762-a9a114d1533c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.189181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d840-e8a3-4cd7-8762-a9a114d1533c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.189461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d840-e8a3-4cd7-8762-a9a114d1533c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.190158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.191466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 53/107] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:41.197722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c4cb-b35a-43e1-82c5-d84647638743 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.198021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c4cb-b35a-43e1-82c5-d84647638743 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.198308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c4cb-b35a-43e1-82c5-d84647638743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.207165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 55/108] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.217081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.242132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c06-76ef-4982-b536-f0f9ad4d52e2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.246742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.248259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.248550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.248810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1995c4cb-b35a-43e1-82c5-d84647638743 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:41.248977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.250012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1995c4cb-b35a-43e1-82c5-d84647638743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:41.250283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.252419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8794f5-bacc-44e4-b697-fb6d68463511 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.254284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 56/109] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.255602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bf254-1e55-4284-8940-cfea4bc72e7a None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.255780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bf254-1e55-4284-8940-cfea4bc72e7a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.256100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422bf254-1e55-4284-8940-cfea4bc72e7a None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.257980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 57/110] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:41.265043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bf254-1e55-4284-8940-cfea4bc72e7a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.271383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 54/111] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:41.274247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.274541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.283450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.295386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422bf254-1e55-4284-8940-cfea4bc72e7a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.314137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:41.315508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:41.315797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.317277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.317773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.318227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.324085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.326577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.328610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 58/112] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.331426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 55/113] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:41.334546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.348227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6ea01-6fd4-4a20-996c-6ddce7d32387 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.352321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.364038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.365282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.365808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.366265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/1dd6f1c3379444b8bbd64274c9643ace/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.371334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3bba62-4ff3-4df1-887d-d98ed6998412 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.371451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, user_id=1dd6f1c3379444b8bbd64274c9643ace, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.373801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.379090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.379931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.380664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.380950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.393536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:41.400735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:41.402001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 56/114] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:41.402865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.412943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ced50-604c-4a1c-9786-328ae136ceac admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.417425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.418218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.418508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.418782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.430677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:41.437737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:41.439017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 57/115] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:41.439901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.449866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8245-0c9e-44d6-bbca-2c5746c6f6b2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.454971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.455635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.455922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.456199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.456941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:41.457247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.458910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.472952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 59/116] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:41 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/1dd6f1c3379444b8bbd64274c9643ace/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:17:41.473692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.475558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 58/117] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.482233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.502818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c7c6-7ab8-4428-a192-f4e4c86cb6ef admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.619434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.620336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.620645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.621195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.623893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765deee1-49f3-4f92-80ba-df92eb86212b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.629641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.631214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.634321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 59/118] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.636754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.637843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.638871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.639261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.639613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.640869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:41.641385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.643668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.657567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5d82-26dc-4f5b-88d7-06b8f42451fe admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.668993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.670049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.670338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.670618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.672937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 60/119] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.673075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.675444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.677347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 60/120] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:41.678568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.683236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.694896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b05c8-7f0f-4b36-8dad-680c093c23c7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.697651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6cbe5-1dbf-4de8-8aae-e442bb3bf492 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.708422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.709393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.709734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.710011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/c1751cf86da943269cce86604e4cfe9e/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.716101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.717472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, user_id=c1751cf86da943269cce86604e4cfe9e, role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.718136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.718630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.719136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.720484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a081e68-c4a3-411b-9295-69ffd1ff905b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.721043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.723525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.725552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 61/121] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.732853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.749498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24484f83-8799-4d26-9c0c-2632a2f0bd0e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.764720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.766155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.766647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.767109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] PATH_INFO: `/v3/projects/ad93756c5b4c451484dc25dbc172c250` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.768661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] RBAC: Authorizing `identity:get_project(project_id=ad93756c5b4c451484dc25dbc172c250)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.770958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.773218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 62/122] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:41 2022] GET /identity/v3/projects/ad93756c5b4c451484dc25dbc172c250 => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:41.778455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:41.789778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a95b3c-24ee-4ee1-8175-4ab3b3d4856e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:41.795036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 61/123] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:41 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/c1751cf86da943269cce86604e4cfe9e/roles/25dd5c2d68ea41728022051659ca3b76 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:17:41.866081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:41.867333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:41.867837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:41.868298 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] PATH_INFO: `/v3/projects/ad93756c5b4c451484dc25dbc172c250/users/c1751cf86da943269cce86604e4cfe9e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:41.876451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad93756c5b4c451484dc25dbc172c250, user_id=c1751cf86da943269cce86604e4cfe9e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:41.879513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bba27-4c61-46cd-bfd7-df735d25dda2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:41.947047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 63/124] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:41 2022] PUT /identity/v3/projects/ad93756c5b4c451484dc25dbc172c250/users/c1751cf86da943269cce86604e4cfe9e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:17:42.456408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75790-276e-4e33-a02b-aa9df827d169 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.456911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75790-276e-4e33-a02b-aa9df827d169 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.456983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c75790-276e-4e33-a02b-aa9df827d169 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.458720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 62/125] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:42.464104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01557-6fd2-41d5-8c0a-e61fd9734a4a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.464974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01557-6fd2-41d5-8c0a-e61fd9734a4a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.465456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01557-6fd2-41d5-8c0a-e61fd9734a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.491490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-82a01557-6fd2-41d5-8c0a-e61fd9734a4a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:42.493016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-82a01557-6fd2-41d5-8c0a-e61fd9734a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:42.594133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 64/126] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:42.633322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75790-276e-4e33-a02b-aa9df827d169 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.654595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c75790-276e-4e33-a02b-aa9df827d169 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:42.656197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e480d-e479-4603-a4a5-e3f4e3b26870 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.656702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e480d-e479-4603-a4a5-e3f4e3b26870 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.657191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e480d-e479-4603-a4a5-e3f4e3b26870 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.659346 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:42.659810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 65/127] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:42.663072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.663072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.663072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.663514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:42.664949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.665239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:42.665641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.666120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.667014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 63/128] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:42.672640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.688775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac4a6d-5575-4c9a-b3d7-0911c0642aed admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:42.690014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:42.691447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:42.700061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:42.700739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.701088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.701368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.702097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:42.704224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:42.706674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 66/129] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:42.734533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.753560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ff50a-1b01-4341-a670-4e6374fdcf56 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:42.762168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:42.762974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.763312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.763617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.784177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:42.790988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:17:42.792219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 67/130] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:17:42.797899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.804643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 64/131] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:17:42 2022] POST /identity/v3/projects => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:17:42.812553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55a890-5287-45ed-a27d-d748fa1ff7de admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:42.898374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:42.899059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.899375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.899645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.900413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:42.900724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:42.902372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:42.914738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 68/132] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:42.920838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.939235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8668-b0e7-4768-a5f3-0d9b2110adbb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:42.947676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:42.948968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:42.949398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:42.949815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] PATH_INFO: `/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:42.971720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b2690a43b4741cfb3134bc22d0dcbd5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:42.974251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:42.976298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 65/133] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:42 2022] GET /identity/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5 => generated 289 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:42.981906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:42.996795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f7d14-0a8c-4bbd-b037-c65c0fde5a61 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:43.006476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:43.007143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:43.007467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:43.007744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:43.023169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:43.025005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:43.042530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 69/134] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:43.048948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:43.062395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47f17-9df0-4bde-be65-f0188299a2a6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:43.071668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:43.072876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:43.073398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:43.073876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:43.080296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:43.082440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0cf9-3518-4eeb-b0be-12f1244cd32f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:43.084551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 66/135] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:43 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:43.090404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:43.100600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cda04-a4e0-4207-8459-2f3e62108357 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:43.112004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:43.112691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:43.112984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:43.113272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:43.114145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=7b2690a43b4741cfb3134bc22d0dcbd5) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:43.114451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:43.116382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535df8dc-31e4-4464-a55d-638aa9804580 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:43.128153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 70/136] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:43 2022] GET /identity/v3/role_assignments?user.id=7b2690a43b4741cfb3134bc22d0dcbd5&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:44.099798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c721-5f19-49bb-8ad4-9456c01654eb None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.100307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c721-5f19-49bb-8ad4-9456c01654eb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.100381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814c721-5f19-49bb-8ad4-9456c01654eb None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.102262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 67/137] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:44.108505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.108915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.109086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.132304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:44.133516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:44.141934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 71/138] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:44.177221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814c721-5f19-49bb-8ad4-9456c01654eb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.193543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814c721-5f19-49bb-8ad4-9456c01654eb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.203476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.204282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.204570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.204850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.227804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:44.234763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:44.236181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 68/139] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:44.241681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.252823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea021a-b8ec-4fa1-b290-a10faec56440 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.263563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.264245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.264537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.264818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.265857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:44.266170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:44.267842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:44.281101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 72/140] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:44.286344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.300827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef605-22d0-4c13-be3c-33c5f7e06b14 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.311611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.312513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.312800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.313075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.314400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:44.316595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:44.318235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 69/141] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:44.323753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.338284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d07d1-dbe9-42b9-9cc1-588fa4cbf844 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.347385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.348048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.348338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.348619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.364172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:44.365914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:44.377625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 73/142] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:44.393532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.409409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b364cd7-fb1f-47d0-b1a0-d6b31c046830 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.420940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.422129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.422402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.422683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.423916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:44.425992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41743a57-e917-4b46-a52f-33df27b1cacd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:44.435458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 70/143] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:44.441083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:44.456012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643383b-056b-4b31-9a68-14869340c83d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:44.467182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:44.467944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.468225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.468496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.469333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:44.469644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:44.471548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263bd09-844f-445e-b008-8debbcd0c73e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:44.478105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 74/144] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:44 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:44.932728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b486af-1161-41cb-b285-b7e114e348fd None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.933018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b486af-1161-41cb-b285-b7e114e348fd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.933303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b486af-1161-41cb-b285-b7e114e348fd None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.935075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 71/145] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:44.957162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:44.957510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:44.957720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:44.984309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:44.985498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:44.993360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 75/146] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:45.029583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b486af-1161-41cb-b285-b7e114e348fd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.045518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b486af-1161-41cb-b285-b7e114e348fd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.049894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.050735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.050987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.051252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.065856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:45.072795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:45.074195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 72/147] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:45.080068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.089052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc0028-9e09-4efa-b724-f3de18714b96 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.098176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.098859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.099137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.099432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.100191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:45.100492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.102103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.115433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 76/148] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.121741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.133938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce679e-18d7-4fb5-8eb1-d5756954b076 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.141313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.141313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.141313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.141313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] PATH_INFO: `/v3/users/1dd6f1c3379444b8bbd64274c9643ace` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.144017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1dd6f1c3379444b8bbd64274c9643ace)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.144489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.146101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 73/149] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/users/1dd6f1c3379444b8bbd64274c9643ace => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:45.151798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.164260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f30530-66e7-467a-9040-88db43f5976d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.172031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.172695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.172978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.173251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.181764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.183602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da29e74-4a46-449b-9225-52200a18cb66 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.196652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 77/150] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:45.202429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.216711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6004-a75f-4a1e-bdef-ca78848d80e4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.218780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7522-501f-4ddf-b943-6f118fcaa74f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.219062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7522-501f-4ddf-b943-6f118fcaa74f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.219351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7522-501f-4ddf-b943-6f118fcaa74f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.221249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 78/151] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:45.227488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.227772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.228044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.232469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.233333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.233617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.233891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.236076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.238138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.239811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 74/152] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.251139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.265553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:45.266738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:45.269880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ccd1-779c-4ad9-934d-34a7dce95739 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.276470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.277128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.277411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.277688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.278517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=1dd6f1c3379444b8bbd64274c9643ace) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:45.278854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.280736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.287676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 79/153] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:45.297187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 75/154] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/role_assignments?user.id=1dd6f1c3379444b8bbd64274c9643ace&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.311707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.324714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105048-e9cb-4f5a-8bd0-85a3d0201ba6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.334659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.335499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.335779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.336050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.356516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:45.364049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:45.365328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 80/155] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:45.371480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.389545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2a23-15e6-4e33-a700-ce5f6609f5cd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.399786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.400487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.400775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.401055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.401831 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:45.402150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.403935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.425807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 76/156] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.431472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.445076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9147b98-8101-4ef8-b797-e0a61052921c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.454591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.455506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.455792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.456066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.460139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.462329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.464074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 81/157] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.469863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.484920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a2dd-cccc-4247-814b-5957b6e59f2a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.495686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.496353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.496640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.496924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.513115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.515776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.531942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 77/158] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:45.537477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.557865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70a5f9-3923-4cbb-b080-2870a5f65349 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.568051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.568924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.569208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.569481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.570762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.576830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27b0d0-2c9f-4399-aa1a-513620ad722c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.576830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 82/159] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.581142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.593003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b955a-cf41-487d-9ad2-a6e73ed12c96 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.599567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.600229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.600515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.600795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.601630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:45.601940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.603843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f6d4-baf8-468d-9e6d-c01100d5d9a8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.612456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 78/160] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.822599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2091-4ba8-4b3f-8b0e-3b9c9f60c6a2 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.822939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2091-4ba8-4b3f-8b0e-3b9c9f60c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.823109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef2091-4ba8-4b3f-8b0e-3b9c9f60c6a2 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.825145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 83/161] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:45.831011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.831321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.831624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.850890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:45.852100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:45.862048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 79/162] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:45.892204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef2091-4ba8-4b3f-8b0e-3b9c9f60c6a2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.905863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef2091-4ba8-4b3f-8b0e-3b9c9f60c6a2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.910259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.911052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.911351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.911630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.924285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:45.931614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:45.932940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 84/163] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:45.939630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.948983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209ab73-942e-4b95-a7af-40e8c4f7713c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.953381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.954052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.954335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.954610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.955390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:45.955699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.957288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.965828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 80/164] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.971367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:45.981095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af458f5-2a3c-4366-a112-9122a9fb1ebd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:45.985897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:45.986738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:45.987020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:45.987292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] PATH_INFO: `/v3/users/c1751cf86da943269cce86604e4cfe9e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:45.988487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1751cf86da943269cce86604e4cfe9e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:45.990620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:45.992216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 85/165] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/users/c1751cf86da943269cce86604e4cfe9e => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:45.997433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.007591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d102820-357d-46d1-bd47-fe2adaba27e2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.011779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.012407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.012690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.012965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.020849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.022600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.031139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 81/166] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:46.036692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.047368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece10c1-71de-4571-ae81-1819cb3d0709 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.051807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.052744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.053090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.053433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] PATH_INFO: `/v3/projects/ad93756c5b4c451484dc25dbc172c250` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.054705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] RBAC: Authorizing `identity:get_project(project_id=ad93756c5b4c451484dc25dbc172c250)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.056887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0e893-a7d9-434c-b20a-0e622bea6c2b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.058867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 86/167] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/projects/ad93756c5b4c451484dc25dbc172c250 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.065251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.074624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5b680-d555-4923-9f28-78b434236fd0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.079018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.079723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.080012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.080282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.081115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=ad93756c5b4c451484dc25dbc172c250, user.id=c1751cf86da943269cce86604e4cfe9e) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:46.081424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.083283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6eb2f6-0f24-46dd-8ca1-0f5fd685dae4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.090183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 82/168] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/role_assignments?user.id=c1751cf86da943269cce86604e4cfe9e&scope.project.id=ad93756c5b4c451484dc25dbc172c250&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.520955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c937e-1bea-435a-a9ac-a32a3c3f6c56 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.521461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c937e-1bea-435a-a9ac-a32a3c3f6c56 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.521546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c937e-1bea-435a-a9ac-a32a3c3f6c56 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.523421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 87/169] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:46.528576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cdc0-a9fe-4781-ab87-ce1086f700e8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.529448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cdc0-a9fe-4781-ab87-ce1086f700e8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.529646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417cdc0-a9fe-4781-ab87-ce1086f700e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.547635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9417cdc0-a9fe-4781-ab87-ce1086f700e8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:46.548798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9417cdc0-a9fe-4781-ab87-ce1086f700e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:46.556257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 83/170] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:46.579242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c937e-1bea-435a-a9ac-a32a3c3f6c56 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.592006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c937e-1bea-435a-a9ac-a32a3c3f6c56 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.596188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.596965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.597253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.597529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.607572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:46.608140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9fe74-2fcc-431f-ba4e-f604e4afda93 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.608430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9fe74-2fcc-431f-ba4e-f604e4afda93 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.608702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9fe74-2fcc-431f-ba4e-f604e4afda93 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.610451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 84/171] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:46.614405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:17:46.615276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.615608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.615768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 88/172] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:46.615891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.621293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.630532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ff140-0007-4f23-b699-de51c2960ef7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.632983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:46.634143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:46.634878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.635534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.635823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.636102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.636840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:46.637150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.639282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.642533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 85/173] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:46.648063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 89/174] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.653492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.663055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f192d6-bb57-41a6-b01c-05c0537ba97c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.667518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.667693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.668465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.668756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.669035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] PATH_INFO: `/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.670256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] RBAC: Authorizing `identity:get_user(user_id=7b2690a43b4741cfb3134bc22d0dcbd5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.672435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.674009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 86/175] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.676623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a4f6c-507c-42d8-bac7-6d9da1d8ad1a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.679157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.680808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.681562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.681842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.682112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.683245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.684995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.686516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 90/176] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.688488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe91e0-9582-4963-bdad-737015859e8b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.691441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.692806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.693593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.693878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.694153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.695316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.697389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.698990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 87/177] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:46 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:46.700379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae58e-16f3-47f6-9d2b-7637f19df97c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.704652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:46.705346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.705790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.706077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.706355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.707056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.708981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecb0e8-5832-4511-9655-796d96765f2d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.713762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2c00a-a28e-4039-8363-199dd257a34a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:46.719172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:46.720049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:46.720334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:46.720609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/7b2690a43b4741cfb3134bc22d0dcbd5/roles/8532a5cc18614e288f599b5f0ba742c2` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:46.722520 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, user_id=7b2690a43b4741cfb3134bc22d0dcbd5, role_id=8532a5cc18614e288f599b5f0ba742c2)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:46.725164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf65be-df86-40a3-ae10-432f6af2b865 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:46.832653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 91/178] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:46 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:17:46.837891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 88/179] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:46 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/users/7b2690a43b4741cfb3134bc22d0dcbd5/roles/8532a5cc18614e288f599b5f0ba742c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:17:49.166089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef852b-fbf6-4e32-8844-93300a548731 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.166644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef852b-fbf6-4e32-8844-93300a548731 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.166644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef852b-fbf6-4e32-8844-93300a548731 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.168454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 92/180] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:49.173902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0182-9d4d-400f-af41-d6fb4f163a3e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.174717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0182-9d4d-400f-af41-d6fb4f163a3e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.175221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db0182-9d4d-400f-af41-d6fb4f163a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.194322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-53db0182-9d4d-400f-af41-d6fb4f163a3e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:49.195618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-53db0182-9d4d-400f-af41-d6fb4f163a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:49.254304 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 89/181] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:49.268796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65582f-870f-44c4-bb11-2f281c6367e5 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.269084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65582f-870f-44c4-bb11-2f281c6367e5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.269386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65582f-870f-44c4-bb11-2f281c6367e5 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.271399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 93/182] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:49.276695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.277192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.277674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.283847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65582f-870f-44c4-bb11-2f281c6367e5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.297050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:49.298250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65582f-870f-44c4-bb11-2f281c6367e5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.298695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:49.303191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.304076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.304428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.304767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.307519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 90/183] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:49.317161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:49.324233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:17:49.326226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 94/184] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:49.331934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.332809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.342082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27381-9245-4574-90a4-5f7337c3d1fa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.343762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f970f-7759-43ea-bb5e-13682a9ee849 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.346924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.347810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.348110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.348383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.349172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.349477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.349917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.351054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.351158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.351653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.352127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.360116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 91/185] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.363408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:49.365471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.371038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:49.373020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 95/186] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:17:49.377708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dacb0-ec39-45cd-8e49-76a3eebb6da9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.378764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.381458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.382310 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.382590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.382862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] PATH_INFO: `/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.384091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b2690a43b4741cfb3134bc22d0dcbd5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.386411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.388219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 92/187] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/users/7b2690a43b4741cfb3134bc22d0dcbd5 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:49.391220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c58bd-c448-4bf1-b3ca-f2ec80e0bcef admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.394061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.397344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.409462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.409894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f2661-05cb-4ce5-b2a1-a65113ee79f4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.409894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.409894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.409894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.410140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.412207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 96/188] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.418785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.426898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.428767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.430160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eeb8c-e5c6-4bf0-8672-e7473e99aa94 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.439331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.439331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.439331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.439621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 93/189] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:49.439694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.444319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.454032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31f050-beb3-48ab-a845-ff4db126f431 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.458438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.459270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.459590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.459868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.461048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.463109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaa3d1-d6de-4e0e-981b-afd77b47af25 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.464801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 94/190] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:49.465998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c22a-1c29-49d4-b9e6-ef7ec3ba8d05 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.466317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c22a-1c29-49d4-b9e6-ef7ec3ba8d05 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.466603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c22a-1c29-49d4-b9e6-ef7ec3ba8d05 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.468253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 95/191] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:49.469331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021014d-838e-4da2-8e2e-61689c14f37a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.469616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021014d-838e-4da2-8e2e-61689c14f37a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.469896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021014d-838e-4da2-8e2e-61689c14f37a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.471541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 96/192] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:49.472242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021014d-838e-4da2-8e2e-61689c14f37a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.484463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021014d-838e-4da2-8e2e-61689c14f37a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.484987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.487141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038b1ee-cbd1-4608-97e7-dbc727bdb796 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.488741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.488880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 97/193] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.489360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.489647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.489924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.490195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.490486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.490749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f, user.id=7b2690a43b4741cfb3134bc22d0dcbd5) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.490850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.491062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.493219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6073d-e1e0-473a-a2b0-a5e955e7ba83 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.502102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 97/194] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/role_assignments?user.id=7b2690a43b4741cfb3134bc22d0dcbd5&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.505724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.505724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.505724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.510316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:49.511659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:49.522360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 98/195] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:49.523588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.533600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a206ce-4ce6-4087-93d3-e08ad890c7df None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.538706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.539442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.539725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.540000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.545784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:49.548206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:49.549464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.551332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.556770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 98/196] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:49.557813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.564735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 99/197] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:49.570547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.571472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e0a9-96a9-4019-973a-0f8d827732db None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.577111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.578203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.578669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.579124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.581275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.582124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c5d4-b78a-4dc2-97ec-5d5f3a23732a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.583475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.585385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 99/198] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.588618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.591222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.592299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.592583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.592852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.594110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.596284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.598027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 100/199] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:49.598789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.600328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98d1d-f2e4-4cd5-821b-7ddfc1e78f3a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.607752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.608587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.608872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.609147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.613151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58dde8-eeea-4f79-acbc-84703edc678e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.617563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.618239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.618523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.618796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.619657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.620728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:49.621593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.628979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:49.630448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 100/200] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:49.631069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.642143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86924a7-f37c-4b40-a894-a6ad79a621ff admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.646693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.647393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.647681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.647961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.648801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=a343b91d2a4d48dcb2960a80ff90262e) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.649116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.651000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.657350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 101/201] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/role_assignments?user.id=a343b91d2a4d48dcb2960a80ff90262e&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.657981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.668244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca22233-a93f-4bfc-b77d-a7596b014b58 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.673681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.674306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.674592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.674872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.675687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.676001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.677747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.688763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 102/202] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.695226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.710253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea151d9-9462-4bd8-b5d3-ab4b7b9874a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.719257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 101/203] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:49 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:49.727836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.729225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.729844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.730348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.732836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.735585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.737986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 103/204] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:49.744498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.758445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82460ade-0a21-4357-bb02-36943e7f2c50 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.763429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.764108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.764397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.764675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.778697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.781084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.791780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 102/205] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:49.797990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.808504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778cc-7fe8-4a41-9396-95f81a7b4c26 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.814074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.814967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.815251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.815601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.816939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.819254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa9f88-eb10-4af4-9af6-5e54a83d2d70 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.821386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 104/206] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:49.827850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:49.837709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a18360-556d-418e-a4ee-5b402fcf316e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:49.842757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:49.843494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:49.843841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:49.844120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:49.846499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=a343b91d2a4d48dcb2960a80ff90262e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:49.847149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:49.849499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b0937-3f03-46ec-8058-48e97888b25e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:49.856326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 103/207] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:49 2022] GET /identity/v3/role_assignments?user.id=a343b91d2a4d48dcb2960a80ff90262e&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:51.987282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d502-0e39-43a2-98cc-3e6431d6c014 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:51.987832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d502-0e39-43a2-98cc-3e6431d6c014 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:51.987906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d502-0e39-43a2-98cc-3e6431d6c014 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:51.989650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 105/208] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:51.994873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:51.995289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:51.995476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.013755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:52.014950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:52.023082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 104/209] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:52.046193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d502-0e39-43a2-98cc-3e6431d6c014 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.061390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d502-0e39-43a2-98cc-3e6431d6c014 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.065929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.066790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.067152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.067534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.078998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:52.086024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:52.087500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 106/210] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:52.093738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.102954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435e93e-665e-41d0-9884-518cd0af52dc None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.107621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.108287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.108572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.108847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.109607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:52.109915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.111541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.119980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 105/211] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.125504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.136261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259377a-8b0f-49f7-84f9-626a309ad335 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.141559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.142587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.142880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.143161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.144499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.146656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc0c62-10b9-4db3-a669-bb40dd644e31 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.148408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 107/212] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.153795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.164145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad8a-fccd-4a6a-be65-6480eda46d5e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.168643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.169508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.169795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.170072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.171277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.173379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.175201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 106/213] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.180069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f1f3-a3ea-407b-bf05-2afdb069be92 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.180505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f1f3-a3ea-407b-bf05-2afdb069be92 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.180695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f1f3-a3ea-407b-bf05-2afdb069be92 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.181362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.182396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 108/214] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:52.188009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ae04-c797-41e1-b6fa-7e690d62d10d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.188783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ae04-c797-41e1-b6fa-7e690d62d10d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.188783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ae04-c797-41e1-b6fa-7e690d62d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.192080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd56ab-80a8-4e0c-b0f3-78fc17bb2c2d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.196621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.197557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.197850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.198133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/a343b91d2a4d48dcb2960a80ff90262e/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.200159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, user_id=a343b91d2a4d48dcb2960a80ff90262e, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.203407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d4107-9e00-4662-82b9-f08b4daa3c3b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.282114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9a53ae04-c797-41e1-b6fa-7e690d62d10d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:52.283324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9a53ae04-c797-41e1-b6fa-7e690d62d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:52.290832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 109/215] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:52.292098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c071e-edd0-43fc-9fce-a97c2976d342 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.292387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c071e-edd0-43fc-9fce-a97c2976d342 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.292666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c071e-edd0-43fc-9fce-a97c2976d342 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.294414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 110/216] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:52.295410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890d29-b983-4d75-828f-5b811f6eb8f6 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.295709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890d29-b983-4d75-828f-5b811f6eb8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.295985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab890d29-b983-4d75-828f-5b811f6eb8f6 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.297725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 111/217] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:52.300448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.300785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.301066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.304311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 107/218] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:52 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/a343b91d2a4d48dcb2960a80ff90262e/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:17:52.305777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.306128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.306411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.320701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:52.321968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:52.331697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:52.333135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:52.393650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 112/219] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:52.394895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.417348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 108/220] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:52.417540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276f5b-4118-4457-a454-7003b07b740d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.421714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.426168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.426168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.426168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.426168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.441784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:52.442925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d3ef9-644d-45d9-9c9e-932f8e37c0d6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.447405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.448212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.448496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.448773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.449330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:52.449958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.451277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 113/221] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:52.456467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.456633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.456633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 109/222] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:52.457813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.468079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01f023-acd8-48dc-b9bb-b42326c5142f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.470583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837cef5-4d32-4c6d-ab8c-d492ba87b89c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.472680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.473491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.473778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.474047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.475371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.476114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.476335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.476612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.477371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:52.477684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.479321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.487852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:52.489422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 110/223] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:52.490473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.494973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:52.496213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 114/224] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:52.497875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.505810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd49c25-e8f4-4082-891b-2f4e2a153f3c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.508734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecabfd-aad8-493e-8e4a-906acfeb7b86 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.510713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.511425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.511705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.511986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.512711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.513524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.514374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.514621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.514721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.514919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.516409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.518497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.520274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 115/225] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.524430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.538707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa008e0-49e2-4536-9811-ef76457faee1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.540302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.540952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.541233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.541507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.542256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:52.542549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.544147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.552940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 116/226] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.553769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.562920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703bf54-cfc1-498c-8f66-a3e3d6e241e7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.567238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.568098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.568378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.568659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.569823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.571848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.573527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 117/227] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.577203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.584233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241510-a83a-4522-998d-c9312b4884ea admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.588486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.589299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.589578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.589851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] PATH_INFO: `/v3/users/af0e0fe7e4e94e95b49c9221372a62cd` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.604010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] RBAC: Authorizing `identity:get_user(user_id=af0e0fe7e4e94e95b49c9221372a62cd)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.605354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 111/228] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:52 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:52.606281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.606694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.608011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 118/229] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/users/af0e0fe7e4e94e95b49c9221372a62cd => generated 297 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:52.617546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952d90-8372-41de-adfc-231ad64fe750 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.622164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.623412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.623708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.623989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/a343b91d2a4d48dcb2960a80ff90262e/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.624952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.626637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, user_id=a343b91d2a4d48dcb2960a80ff90262e, role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.629594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdf6b4-1952-4056-bd7e-ff50df177bff admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.637744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402fd05-8d3b-456e-8eff-a6fa08d08a70 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.644114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.645213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.645656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.648308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.656544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.658714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.669829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 119/230] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:17:52.676702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.686136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b5cb3-72d5-4a13-b3f8-faef895f94df admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.690619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.691542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.691824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.692098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.693453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.695570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.697532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 120/231] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:52.699996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 112/232] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:52 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/a343b91d2a4d48dcb2960a80ff90262e/roles/25dd5c2d68ea41728022051659ca3b76 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:17:52.707137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:52.724986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc607bbf-4667-4159-9654-fe9ce3784898 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:52.790866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:52.791497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:52.791784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:52.792060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:52.792917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=af0e0fe7e4e94e95b49c9221372a62cd) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:52.793291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:52.795405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666bc63-b92b-4658-92e5-94a6760f9cce admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:52.801812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 121/233] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:52 2022] GET /identity/v3/role_assignments?user.id=af0e0fe7e4e94e95b49c9221372a62cd&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 259 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:54.892337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca8d5-f68f-4d80-a15d-2779143d269d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:54.893352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca8d5-f68f-4d80-a15d-2779143d269d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:54.893829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eca8d5-f68f-4d80-a15d-2779143d269d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:54.896075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 113/234] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:54.912801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:54.913715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:54.914205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:54.941820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:54.943478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:54.952427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 122/235] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:54.988847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eca8d5-f68f-4d80-a15d-2779143d269d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.009243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eca8d5-f68f-4d80-a15d-2779143d269d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.019575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.020370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.020656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.020935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.040209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:55.047686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:17:55.049200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 114/236] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:55.054489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.064568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21437d17-0fc2-4d6e-af66-e5f7a4199c50 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.075248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.076207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.076719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.077196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.078141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:55.078643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.080442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.095216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 123/237] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.099896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.113208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07494d-9ff7-469e-89d9-2e7157691a8b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.119669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.120577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.120860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.121136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.128316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.130529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.132322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 115/238] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.137818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.157894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893644b-5272-4617-86c1-720508871c8b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.160741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.161732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.162226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.162716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.176997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.179284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.190348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 124/239] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:55.195897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.212316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e362a6-9963-41bd-994a-97f98312a078 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.219806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.220666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.220949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.221225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.224086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.226158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca75783-078c-46b8-aed7-f8d6ee142073 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.227901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 116/240] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.234470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.244118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef1454-a53d-4f26-9b8d-093ca8d3c0cb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.249214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.249689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.250207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.250990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.252986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=a343b91d2a4d48dcb2960a80ff90262e) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:55.253832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.256383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46d989-ec54-4dad-b91e-92b68a227316 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.263079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 125/241] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/role_assignments?user.id=a343b91d2a4d48dcb2960a80ff90262e&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.539121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6dd96-fb04-4f2a-bc6f-098cd43a99eb None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.539450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6dd96-fb04-4f2a-bc6f-098cd43a99eb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.539720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6dd96-fb04-4f2a-bc6f-098cd43a99eb None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.541834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 117/242] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:55.547793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d468f-1f28-46cd-b5e4-468d354e39ec None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.548331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d468f-1f28-46cd-b5e4-468d354e39ec None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.548818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d468f-1f28-46cd-b5e4-468d354e39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.566978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2d6d468f-1f28-46cd-b5e4-468d354e39ec None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:55.568584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2d6d468f-1f28-46cd-b5e4-468d354e39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:55.579811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 126/243] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:55.605269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6dd96-fb04-4f2a-bc6f-098cd43a99eb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.616586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28341-2c56-441c-aa4b-e4f9f13c50db None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.616873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28341-2c56-441c-aa4b-e4f9f13c50db None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.617154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d28341-2c56-441c-aa4b-e4f9f13c50db None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.618799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6dd96-fb04-4f2a-bc6f-098cd43a99eb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.619238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 127/244] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:55.623636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.624732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.625034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.625154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.625320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.625548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.625653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.637153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:55.645571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:55.647072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 118/245] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:55.647249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:55.648545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:55.652615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.657327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 128/246] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:55.664695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970ed74-bd21-4a3e-8ad8-a7848731630f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.669917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.670638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.670977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.671324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.672076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:55.672381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.674043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.683053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 119/247] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:55.684839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.689025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.695192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38373bc-90d2-4519-8781-9a8aa0dd27c8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.698817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5a518-27e4-4c75-a9b6-dd6e0d7eae65 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.699692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.700627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.700906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.701176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.705149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.706006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.706342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.706625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] PATH_INFO: `/v3/users/af0e0fe7e4e94e95b49c9221372a62cd` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.707901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] RBAC: Authorizing `identity:get_user(user_id=af0e0fe7e4e94e95b49c9221372a62cd)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.710101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.712018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 120/248] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/users/af0e0fe7e4e94e95b49c9221372a62cd => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:55.714039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:55.717768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.721713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:17:55.727406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 129/249] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:55.728087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d58fc-d4ce-4952-8dd9-1541a5b200ca admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.728757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.733452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.734494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.734957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.735365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.736765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.739080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.741231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 121/250] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.741962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd7b2-710b-4646-9cc1-3758e1832fb4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.746648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.746858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.748058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.748451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.748729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.749478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:55.749782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.751424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.757804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c288ef-f9a8-4888-88b1-68b7621f5355 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.761624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 130/251] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:55.768701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.769119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.777293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.777293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.777293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/af0e0fe7e4e94e95b49c9221372a62cd/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.777293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, user_id=af0e0fe7e4e94e95b49c9221372a62cd, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.777293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6d19-2fea-44a5-98b4-dc4479fe78d8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.780397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29da4a-7d56-405a-9762-eaecd9c5663e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.786070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.786941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.787354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.787638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] PATH_INFO: `/v3/users/a343b91d2a4d48dcb2960a80ff90262e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.790103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] RBAC: Authorizing `identity:get_user(user_id=a343b91d2a4d48dcb2960a80ff90262e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.792306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.793960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 131/252] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/users/a343b91d2a4d48dcb2960a80ff90262e => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.799947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.811496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c919bf4-59f5-434e-bd0f-1d2d9013ec96 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.816355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.817004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.817289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.817564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.826123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.827973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ef52b-c62d-42da-a622-382022147dd2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.837598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 122/253] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:55 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/af0e0fe7e4e94e95b49c9221372a62cd/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:17:55.852172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d811-62be-40dd-9712-e5dff6807f79 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.852519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d811-62be-40dd-9712-e5dff6807f79 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.852911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952d811-62be-40dd-9712-e5dff6807f79 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.854755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 132/254] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:17:55.855039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 123/255] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:55.857690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b654-4c2b-45f7-962a-0838b7d4c1a5 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.857983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b654-4c2b-45f7-962a-0838b7d4c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.858263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b654-4c2b-45f7-962a-0838b7d4c1a5 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.860234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 124/256] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:55.861623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78691-ffd5-4cc1-b206-5cdd27705ce0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.862104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78691-ffd5-4cc1-b206-5cdd27705ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.862426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b654-4c2b-45f7-962a-0838b7d4c1a5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.862740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78691-ffd5-4cc1-b206-5cdd27705ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.884724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-48f78691-ffd5-4cc1-b206-5cdd27705ce0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:55.885955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-48f78691-ffd5-4cc1-b206-5cdd27705ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:55.941443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b654-4c2b-45f7-962a-0838b7d4c1a5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.945901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.946755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.947074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.947312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.948517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 133/257] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:55.948932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.949660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.949960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.950237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.950751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.957483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 125/258] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:55.960426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.971149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:55.972458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:55.974902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f76b-e6b5-408e-8b50-29f59180fead admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:55.979207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:55.979911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:55.980194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:55.980467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:55.981123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 134/259] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:55.981307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=a343b91d2a4d48dcb2960a80ff90262e) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:55.981618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:55.984269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:55.984387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:55.993930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 126/260] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/role_assignments?user.id=a343b91d2a4d48dcb2960a80ff90262e&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:56.007036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.009821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d90a-55e1-4367-8a19-c3c6187642b9 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.022296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.022724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a66f4-3274-4a50-8506-c50e83453270 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.023931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.024463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.025002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.027579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.028459 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.029293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.029577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.032485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.034252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.036227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 127/261] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:56.043641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.046319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:56.053431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:17:56.054881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 135/262] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:56.055936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6477a-f9bb-442e-a49a-7273aa382dff admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.060727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.066881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.067616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.067902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.068178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.068919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.070864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.073554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e233c7-5fc3-49a1-9b2a-0fb488769667 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.078517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.079208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.079547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.079826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.080589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:56.080900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.082554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.093083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 136/263] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:56.098642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.109246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c3ec0-188d-437d-a8a8-bcd939afbd34 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.114071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.114979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.115326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.115565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] PATH_INFO: `/v3/users/68429a15c60548a99ca8ea23765d48ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.133619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] RBAC: Authorizing `identity:get_user(user_id=68429a15c60548a99ca8ea23765d48ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.137151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.139184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 137/264] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/users/68429a15c60548a99ca8ea23765d48ed => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:56.147794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.152867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 128/265] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:56 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:56.160956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e114b5-9222-45d1-b23c-85abd55caf92 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.166300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.167513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.168104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.168601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.179839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.182189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.192751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 138/266] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:17:56.198737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.212017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1df669-bf48-4654-96bd-9adb315e43ec admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.217476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.218361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.218644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.218918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.220243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.222348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48f7cf-96e2-40a5-86c8-2cd11f3cd43d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.229306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 129/267] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:56.230757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:56.242019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10300992-7831-4a53-81c9-27008b213813 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:56.246805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:56.248107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:56.248394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:56.248676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:56.249580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=68429a15c60548a99ca8ea23765d48ed) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:56.249901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:56.251850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926af1a-0ed1-4193-ac21-05b668f3f700 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:56.258733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 139/268] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:56 2022] GET /identity/v3/role_assignments?user.id=68429a15c60548a99ca8ea23765d48ed&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:17:58.213532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231cb1-fc56-4f78-803e-48630852b9f6 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.214043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231cb1-fc56-4f78-803e-48630852b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.214149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c231cb1-fc56-4f78-803e-48630852b9f6 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.216822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 130/269] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:58.222209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.222624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.222795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.242676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:58.243899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:58.252080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 140/270] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:58.276737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c231cb1-fc56-4f78-803e-48630852b9f6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.290383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c231cb1-fc56-4f78-803e-48630852b9f6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.295562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.296386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.296675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.296945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.308566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:58.315541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:58.317058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 131/271] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:58.322673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.331839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b60e-95d7-4119-9be2-ae0a1966b7cd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.336334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.336999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.337283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.337559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.338305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:58.338609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.340232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.349236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 141/272] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.354612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.365427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba106-8591-4d1d-bc9d-de49441b9ce6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.369757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.370603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.370887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.371169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] PATH_INFO: `/v3/users/af0e0fe7e4e94e95b49c9221372a62cd` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.372408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] RBAC: Authorizing `identity:get_user(user_id=af0e0fe7e4e94e95b49c9221372a62cd)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.374531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.376420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 132/273] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/users/af0e0fe7e4e94e95b49c9221372a62cd => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.381730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.391869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c5eaa-8a04-462d-a7e3-e589ea9e6da1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.396343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.396988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.397271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.397560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.406303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.408102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.417211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 142/274] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:17:58.423169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.432723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b720e79-c3cd-4fd4-ad85-3df174fac744 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.437102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.437933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.438217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.438490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.439705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.441749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e668-7b13-4904-af6e-0d728147651f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.443488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 133/275] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.449098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.457912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786886e8-1e74-47c4-8d6b-09e06f1780f5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.462462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.463104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.463417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.463751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.464523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=af0e0fe7e4e94e95b49c9221372a62cd) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:58.464828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.467722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f06f79-cbf7-4895-a58c-aff0efda0c7a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.474704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 143/276] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/role_assignments?user.id=af0e0fe7e4e94e95b49c9221372a62cd&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.648042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82122-ca28-4b27-867c-cd302fc203ac None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.648375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82122-ca28-4b27-867c-cd302fc203ac None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.648589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c82122-ca28-4b27-867c-cd302fc203ac None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.650627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 134/277] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:58.656760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462f94-c8b8-43f9-b5b2-a9207db7b9d4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.657025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462f94-c8b8-43f9-b5b2-a9207db7b9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.657305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3462f94-c8b8-43f9-b5b2-a9207db7b9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.668571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952565e9-f9af-4e97-904d-9e3e4d61cebf None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.668852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952565e9-f9af-4e97-904d-9e3e4d61cebf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.669134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952565e9-f9af-4e97-904d-9e3e4d61cebf None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.671245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 135/278] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:17:58.675978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b3462f94-c8b8-43f9-b5b2-a9207db7b9d4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:58.677869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.678156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.678433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.678922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b3462f94-c8b8-43f9-b5b2-a9207db7b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:58.687921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 144/279] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:58.689237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8bec-2c80-40e8-8a43-71e86a394b7c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.689530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8bec-2c80-40e8-8a43-71e86a394b7c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.689814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae8bec-2c80-40e8-8a43-71e86a394b7c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.691506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 145/280] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:17:58.696715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.697005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.697289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.701524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:58.702779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:58.713348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 136/281] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:17:58.715836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.716033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:17:58.717906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:17:58.727139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 146/282] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:17:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:17:58.729807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fcb1-66bd-4ab4-8854-e72fcf09d62b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.734384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.735178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.735516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.735798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.747898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.748059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:58.754801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:17:58.756206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 137/283] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:58.756918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.759752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd03956-7749-420d-a6d1-bd85844d991e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.765046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.766096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.766375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.766648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.767781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcef72c-ecb5-40e2-876b-9347cd892482 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.767878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.769513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.771094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 147/284] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.771861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.772224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.772986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.773273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.773550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.781652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af883724-e5dd-4cd8-9718-76bebd439778 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.785085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:17:58.786173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.786779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.787066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.787369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.788095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:58.788398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.789908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.791984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:17:58.793139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 138/285] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:17:58.793928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.798196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 148/286] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.798962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.803388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92c34-fb7b-48f0-9a64-567a7d640e68 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.807688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.808311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.808598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.808688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25030-d1ad-4434-9f77-cc5d5b25a1c1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.808877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.809577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.811564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.813016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.813633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.813914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.814186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.814901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:58.815205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.816766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.824929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 149/287] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.826299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.835275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893e047-f1ea-43dc-a980-225223463e60 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.839538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.840336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.840622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.843043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] PATH_INFO: `/v3/users/1ba2f998f6274db98971d9c8b7571324` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.854452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] RBAC: Authorizing `identity:get_user(user_id=1ba2f998f6274db98971d9c8b7571324)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.856575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.858147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 150/288] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/users/1ba2f998f6274db98971d9c8b7571324 => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.858932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.867870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e9e98-ec7b-448a-b373-bb7f6a31734b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.872493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.873268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.873554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.873830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] PATH_INFO: `/v3/users/68429a15c60548a99ca8ea23765d48ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.874972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] RBAC: Authorizing `identity:get_user(user_id=68429a15c60548a99ca8ea23765d48ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.877180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.878669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 151/289] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/users/68429a15c60548a99ca8ea23765d48ed => generated 297 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.879410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.888878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1881d-fb2e-4a82-b555-ff3823a41755 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.893325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.893887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.894171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.894449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.895277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, user.id=1ba2f998f6274db98971d9c8b7571324, scope.system=all) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:17:58.895618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.897336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.905365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 152/290] 10.222.0.65 () {56 vars in 1329 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/role_assignments?user.id=1ba2f998f6274db98971d9c8b7571324&scope.system=all&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.906085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.916221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685f42-9bd9-4122-a6e2-82312dbd45c5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.921685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.922574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.922866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.923145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.924472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.925266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 139/291] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:17:58 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:17:58.926666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b47d6-762f-4c2c-89d3-8ad9a7c52845 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:58.928630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 153/292] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:17:58 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:17:58.936082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:17:58.947014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07d637-7f83-4f62-a573-4e1d3a0bdf91 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:17:58.951996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:17:58.952969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:17:58.953253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:17:58.953577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/68429a15c60548a99ca8ea23765d48ed/roles/8532a5cc18614e288f599b5f0ba742c2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:17:58.955914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, user_id=68429a15c60548a99ca8ea23765d48ed, role_id=8532a5cc18614e288f599b5f0ba742c2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:17:58.958951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ea582-95ac-4413-9d7e-83de6694a7ca admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:17:59.009491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 140/293] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:17:58 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/users/68429a15c60548a99ca8ea23765d48ed/roles/8532a5cc18614e288f599b5f0ba742c2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:01.242593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffdfdd-9a0a-464e-beb5-adae25dc6b7a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.243283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffdfdd-9a0a-464e-beb5-adae25dc6b7a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.243283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffdfdd-9a0a-464e-beb5-adae25dc6b7a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.245110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 154/294] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:01.250571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.251440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.251954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.270630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:01.272179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:01.335399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 141/295] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:01.355500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffdfdd-9a0a-464e-beb5-adae25dc6b7a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.368867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffdfdd-9a0a-464e-beb5-adae25dc6b7a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.373600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.374654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.375163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.375680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.387402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:01.394974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-343dac2a-87d4-44e8-b2f5-091d87c73485 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:01.396917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 155/296] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:01.403369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.413251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191fdcf-0f1e-4185-9455-df395b4b6aca None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.417964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.418845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.419957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.420439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.421404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:01.421914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.423754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.435543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be641-7302-4343-b224-f66e63306666 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.435543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be641-7302-4343-b224-f66e63306666 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.435543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190be641-7302-4343-b224-f66e63306666 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.435543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 156/298] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:01.435909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 142/298] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.437813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d0ad-3ffe-45de-9bf7-66a5b3d19d13 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.438361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d0ad-3ffe-45de-9bf7-66a5b3d19d13 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.438483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416d0ad-3ffe-45de-9bf7-66a5b3d19d13 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.440104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.440540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 157/299] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:01.441611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.441897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.442175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.451032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffc979-b59d-4a19-af23-c4068206a083 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.455338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.456187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.456473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.456751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] PATH_INFO: `/v3/users/1ba2f998f6274db98971d9c8b7571324` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.457937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] RBAC: Authorizing `identity:get_user(user_id=1ba2f998f6274db98971d9c8b7571324)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.460181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ee8c-e524-4955-806f-853de5e683bb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.460601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:01.461757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 143/300] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/users/1ba2f998f6274db98971d9c8b7571324 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.462121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:01.462862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.463147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.463447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.473416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 158/301] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:01.474344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.483654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:01.484292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39ce79-3b60-451b-94c0-be0dfc28111f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.484818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:01.489011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.490066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.490519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.490965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] PATH_INFO: `/v3/system/users/1ba2f998f6274db98971d9c8b7571324/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.492715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ba2f998f6274db98971d9c8b7571324, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.492828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 144/302] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:01.494037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:01.494037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:01.494037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:01.494927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627cbac-c802-434e-acc1-a213ad625caf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.505376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.513803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2c81b-2e82-43bf-b626-f73843d76b20 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.518742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.519578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.519861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.520135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.521305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.522999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.529454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 145/303] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:01.529454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.536656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bec76a-412a-43d7-baaf-e357bf7e6817 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.540970 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.541720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.541992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.542300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.553051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:01.559959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:18:01.561091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 146/304] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:01.561972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.564153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 159/305] 10.222.0.65 () {58 vars in 1355 bytes} [Mon Feb 21 09:18:01 2022] PUT /identity/v3/system/users/1ba2f998f6274db98971d9c8b7571324/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:01.565353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e8a2-bf54-4500-848a-14151d134118 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.565941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e8a2-bf54-4500-848a-14151d134118 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.566225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27e8a2-bf54-4500-848a-14151d134118 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.568041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 160/306] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:01.568733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e8a2-bf54-4500-848a-14151d134118 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.579005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d582f-7957-4407-9d97-0eb406959230 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.582379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27e8a2-bf54-4500-848a-14151d134118 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.583631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.584382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.584669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.584962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] PATH_INFO: `/v3/groups` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.585638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.586712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:01.586712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:01.586712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:01.587958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.589061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.590059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.590524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.591658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.592656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:01.592973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.594757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea328-460e-4b1d-bce0-5b44a007aa83 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.604157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 161/307] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.605486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.605781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.606064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.625136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:01.626397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:01.634290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 162/308] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:01.635148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.645669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0ca3-9872-46f5-9f96-f68c2d649444 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.650506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.651471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.651766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.652046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] PATH_INFO: `/v3/users/68429a15c60548a99ca8ea23765d48ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.653290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] RBAC: Authorizing `identity:get_user(user_id=68429a15c60548a99ca8ea23765d48ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.656126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.658099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 163/309] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/users/68429a15c60548a99ca8ea23765d48ed => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.662733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 147/310] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Feb 21 09:18:01 2022] POST /identity/v3/groups => generated 229 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:01.663040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.664224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.680573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48ea91-8eac-4744-a927-82252af13a3f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.681877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ffb7-90d0-4162-adcd-47f12fe95ca3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.685729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.686485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.693611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.693611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.693834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.693834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.693834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.693834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.696377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.698369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.703064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:01.709657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 148/311] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:01.711906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:18:01.713171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 164/312] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:01.716976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.721621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.726800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7472-b214-4b8c-950d-f5514bbf799c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.732913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.733590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850701-8834-4d64-b1d6-d0a5e481fa5e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.733794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.734126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.734433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.735761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.737867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.738535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.739356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.739654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.739940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.740782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:01.741096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.743167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.745426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 149/313] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:01.746422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.753168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 165/314] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.758349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7c42-f84d-49da-a4f8-f7543918649d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.760337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.772911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.774142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.774567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.774977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.776000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087176-3fce-4521-9e74-bc5c1f16f240 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.776175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, scope.project.id=4aebba61657b49cab411fe2db3d11bfb, user.id=68429a15c60548a99ca8ea23765d48ed) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:01.776621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.780196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.783037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.784077 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.784404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.785117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] PATH_INFO: `/v3/users/a9fb97fe27144e50a7890a7c84f48273` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.788524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 150/315] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/role_assignments?user.id=68429a15c60548a99ca8ea23765d48ed&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:01.807822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] RBAC: Authorizing `identity:get_user(user_id=a9fb97fe27144e50a7890a7c84f48273)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.810530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93a19-8c93-4981-bd62-ad174f52260b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.812972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 166/316] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/users/a9fb97fe27144e50a7890a7c84f48273 => generated 293 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:01.825054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:01.857409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8093-afa5-41dc-ab92-f096011a6127 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:01.874160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:01.874160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:01.874160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:01.874544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:01.875337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, user.id=a9fb97fe27144e50a7890a7c84f48273, scope.system=all) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:01.879328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:01.879328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffd951-2b18-4d52-958d-f8d66458a00b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:01.887334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 151/317] 10.222.0.65 () {56 vars in 1329 bytes} [Mon Feb 21 09:18:01 2022] GET /identity/v3/role_assignments?user.id=a9fb97fe27144e50a7890a7c84f48273&scope.system=all&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 226 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:03.972910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cc393-62ce-4666-be21-391133de916e None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:03.973421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cc393-62ce-4666-be21-391133de916e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:03.973527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cc393-62ce-4666-be21-391133de916e None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:03.975374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 167/318] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:03.980671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:03.981076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:03.981238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:03.998768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:03.999993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:04.007522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 152/319] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:04.031714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cc393-62ce-4666-be21-391133de916e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.043852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cc393-62ce-4666-be21-391133de916e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.048277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.049057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.049337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.049607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.059593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:04.066338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:04.067784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 168/320] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:04.073302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.082946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c0973-7efe-47df-bc37-9d5efca9bbe3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.088335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.089285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.089798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.090169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.091062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:04.091949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.093644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.102389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 153/321] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:04.107681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.117152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918ceb-112a-47a7-838e-a285a94f8a89 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.121350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.122228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.122515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.122791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] PATH_INFO: `/v3/users/1ba2f998f6274db98971d9c8b7571324` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.124017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ba2f998f6274db98971d9c8b7571324)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.126146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ad0fb-7507-44e8-b323-01cdd4064413 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.127880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 169/322] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/users/1ba2f998f6274db98971d9c8b7571324 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:04.133250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.143986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70c469-00ea-4a42-9bbd-dbeb65a7191b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.148185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.148903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.149090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.149367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.150251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] RBAC: Adding query filter params (role.id=588f5e2f6b5c466bafbf0fe06ec211aa, user.id=1ba2f998f6274db98971d9c8b7571324, scope.system=all) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:04.150563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.152458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003805-93b5-4ef7-bd1f-a09b093ea78a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.168038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 154/323] 10.222.0.65 () {56 vars in 1329 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/role_assignments?user.id=1ba2f998f6274db98971d9c8b7571324&scope.system=all&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 510 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:04.233260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796b3-17b4-429b-a9cb-ee57bf523a55 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.233551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796b3-17b4-429b-a9cb-ee57bf523a55 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.233738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796b3-17b4-429b-a9cb-ee57bf523a55 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.235722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 170/324] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:04.239668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720211c-cd83-4e85-a21e-48ae06eb4c9d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.239961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720211c-cd83-4e85-a21e-48ae06eb4c9d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.240240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720211c-cd83-4e85-a21e-48ae06eb4c9d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.240864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.241163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.241448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.242226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 155/325] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:04.248301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.248592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.248864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.261694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:04.263551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:04.269046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:04.270233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:04.271954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 171/326] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:04.278074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 156/327] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:04.295181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.300481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.304728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25252-d93a-4ef6-87bb-59efec097292 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.309269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.310386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90c450-b329-424e-8b92-3574425fc053 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.310623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.310908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.311220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.312427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.314170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.315010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.316040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 172/328] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:04.316143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.316143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.316391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.321490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.328668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:04.331984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cde5f3-4834-44b4-beae-5d48da137d9d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.335803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:18:04.336299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.336958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.337732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.337836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 157/329] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:04.337909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] PATH_INFO: `/v3/groups` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.338387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.339449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:04.339449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:04.339449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:04.341038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459720-4bdc-4f4b-a8da-51b2dbbdbd8b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.342814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.352814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741cd6-c435-4ef4-8724-20c8cdafeeea admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.357260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.357904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.358188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.359210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.359311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:04.359573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.361167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.370208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 158/330] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:04.376281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.385712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bf7a-275e-42f6-96e1-2b8f4c107547 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.391023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.391916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.392198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.393857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] PATH_INFO: `/v3/users/a9fb97fe27144e50a7890a7c84f48273` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.393857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] RBAC: Authorizing `identity:get_user(user_id=a9fb97fe27144e50a7890a7c84f48273)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.395768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.397358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 159/331] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:04 2022] GET /identity/v3/users/a9fb97fe27144e50a7890a7c84f48273 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:04.402706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:04.409039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 173/332] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Feb 21 09:18:04 2022] POST /identity/v3/groups => generated 226 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:04.417223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6718b06-d36e-4668-9762-9e05a46a65bc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:04.417223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:04.417903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:04.418183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:04.418458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] PATH_INFO: `/v3/system/users/a9fb97fe27144e50a7890a7c84f48273/roles/8532a5cc18614e288f599b5f0ba742c2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:04.420186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a9fb97fe27144e50a7890a7c84f48273, role_id=8532a5cc18614e288f599b5f0ba742c2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:04.421230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:04.421230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:04.421230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:04.422116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081df707-8146-4a71-a143-6e25f46c41f9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:04.489872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 160/333] 10.222.0.65 () {58 vars in 1355 bytes} [Mon Feb 21 09:18:04 2022] PUT /identity/v3/system/users/a9fb97fe27144e50a7890a7c84f48273/roles/8532a5cc18614e288f599b5f0ba742c2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:18:07.132959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36cd6-1f5a-4ca7-9603-6a30eb3d76dd None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.133562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36cd6-1f5a-4ca7-9603-6a30eb3d76dd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.133562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc36cd6-1f5a-4ca7-9603-6a30eb3d76dd None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.135512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 174/334] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:07.141965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.145914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.145914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.162103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:07.163322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:07.177451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 161/335] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:07.218366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc36cd6-1f5a-4ca7-9603-6a30eb3d76dd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.237770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc36cd6-1f5a-4ca7-9603-6a30eb3d76dd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.242190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.242997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.243280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.243586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.255841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:07.263153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:07.265372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 175/336] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:07.270413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.280220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073fad3-c19c-41e1-8046-ddb9b8e4fa95 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.286846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.291754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.300207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 162/337] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:07.305870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.320413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6f7e9-b2f8-4dbd-a536-93069051e4a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.325093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.325723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.326010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.326287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.339518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.341915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.352797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 176/338] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:18:07.359357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.369739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17949-a32b-448b-99fa-3d8b6ea24b36 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.375138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.382537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.382537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.382537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.382537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.382537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.384246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 163/339] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.389701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.404907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cc85-ded8-4dac-9232-fab5f5a42b5a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.414978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.415879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.416919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.416919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.423666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.424706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:07.424706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:07.424706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:07.425901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dfdbb-8acf-4020-a58a-c83e7bc5ef5a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.428749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 177/340] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.433646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.449672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d77764-5045-469f-b27e-6af4d4cca6da admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.459464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.460122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.460409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.460690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.461534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:07.461850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.463739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a309e41-b08d-4fc1-b27a-3f31d9df9a08 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.475722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 164/341] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.514297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ece8-0b27-4585-b01c-ea629bc08d0b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.514621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ece8-0b27-4585-b01c-ea629bc08d0b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.514854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112ece8-0b27-4585-b01c-ea629bc08d0b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.517263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 178/342] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:07.522988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06332-acd7-440c-aac9-b422d523836a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.523284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06332-acd7-440c-aac9-b422d523836a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.523598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06332-acd7-440c-aac9-b422d523836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.552497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-27c06332-acd7-440c-aac9-b422d523836a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:07.553728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-27c06332-acd7-440c-aac9-b422d523836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:07.561988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 165/343] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:07.610212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112ece8-0b27-4585-b01c-ea629bc08d0b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.629248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112ece8-0b27-4585-b01c-ea629bc08d0b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.633871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.634804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.635012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.635215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.655069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:07.662202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f48f0d88-0130-4ba8-b28c-b39a2a99dd87 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:18:07.663485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 179/344] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:07.669310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06332-acd7-440c-aac9-b422d523836a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.684678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06332-acd7-440c-aac9-b422d523836a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.692107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cde24a-5562-47e4-8d4c-fdaffc52ab88 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.692522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cde24a-5562-47e4-8d4c-fdaffc52ab88 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.692917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cde24a-5562-47e4-8d4c-fdaffc52ab88 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.695596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 180/345] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:07.695801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.696351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.696635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.696916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.697683 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:07.697994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.699651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.701046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.701342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.701788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.718555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 166/346] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.721872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:07.723205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:07.724102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.734238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 181/347] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:07.741905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462cc8d-032b-460d-8198-3fb388a09d63 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.747628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.748507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.748795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.749074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] PATH_INFO: `/v3/users/a9fb97fe27144e50a7890a7c84f48273` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.750290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] RBAC: Authorizing `identity:get_user(user_id=a9fb97fe27144e50a7890a7c84f48273)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.752496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.754174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 167/348] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/users/a9fb97fe27144e50a7890a7c84f48273 => generated 293 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:07.760180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.771197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67be9dc-2918-4d56-9fef-9a39facfd4c2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.772831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.782265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.782948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.783233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.789750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.789750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] RBAC: Adding query filter params (role.id=8532a5cc18614e288f599b5f0ba742c2, user.id=a9fb97fe27144e50a7890a7c84f48273, scope.system=all) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:07.789750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.789750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.790423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0efa8-887b-4766-b503-9ae4803791de admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.799674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.800935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.801455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.801979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.806543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 182/349] 10.222.0.65 () {56 vars in 1329 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/role_assignments?user.id=a9fb97fe27144e50a7890a7c84f48273&scope.system=all&role.id=8532a5cc18614e288f599b5f0ba742c2 => generated 510 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.832209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:07.839513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:07.841728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 168/350] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:07.847236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.857446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca22ad-6b49-431c-9b07-09ecd4c5c0ff admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.867411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.868109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.868398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.868676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.869446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:07.869763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.871440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.881742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 183/351] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.888961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.901268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ac21-e09d-4a3f-868f-db8e8132f824 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.906479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.907135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.907455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.907737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.919745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.924112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.949089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 169/352] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:07.954611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.964609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e2f59-cc01-4db6-9b89-49faa6489b8b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:07.975449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:07.976332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:07.976614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:07.976888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:07.978094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:07.980184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463abe0-cc03-4694-9319-94c869d7d1a8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:07.982838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 184/353] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:07.988019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:07.997196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2b94-7ac1-498b-a61c-5829120aec95 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.003955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4fa4-10a8-4f34-b2aa-316a27878ad5 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.004242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4fa4-10a8-4f34-b2aa-316a27878ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.004623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e4fa4-10a8-4f34-b2aa-316a27878ad5 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.006207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.006676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 185/354] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:08.007379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.007665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.007939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.010998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.012088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:08.012088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:08.012088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:08.013323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.015383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 170/355] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:07 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.020395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.020695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.020969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.021310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.035005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55855-c38b-41bb-a46d-e37a9a42bd31 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.043398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:08.045205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:08.051463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.052134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.052413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.052796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.053521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=4aebba61657b49cab411fe2db3d11bfb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:08.053830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.055720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.058526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 186/356] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:08.068248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 171/357] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.088154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.098450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3147cd9-64cf-470a-a197-eacf2bb4bf1a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.104341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.105193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.105474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.105749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.118544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:08.125748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:08.127457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 187/358] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:08.133129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.154386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b3158-18b6-4f3a-bb05-e559bbcb21d0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.162269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.162951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.163231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.163535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.164290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:08.164590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.166200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.178833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 172/359] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.184681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.195003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ac6a-f76b-4eb4-8637-458464d331ed admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.204372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.205053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.205334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.205612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.220732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.222532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.233660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 188/360] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:08.238786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.265948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5e822-17f9-4bd3-afde-1c960f723672 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.281563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.282437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.282722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.282997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.288195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.290266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.292339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 173/361] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.298394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.313065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df4708-9226-4bc0-bfc7-4c449de72783 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.323486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.324378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.324663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.324938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.332377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.334333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b20ef-4eee-481a-8cfd-79bb6255f0d3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.336474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 189/362] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.342469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:08.356396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb8ea9-af1d-4bbf-b79e-787af44d6a7d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:08.368099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:08.368774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.369055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.369331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.370171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:08.370480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:08.372407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49fe7-9b75-451a-93e8-855769b37206 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:08.378446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 174/363] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:08 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:08.989176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff224bc0-5a68-408e-9102-a6af59818b26 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.989176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff224bc0-5a68-408e-9102-a6af59818b26 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.989176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff224bc0-5a68-408e-9102-a6af59818b26 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:08.989176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 190/364] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:08.996136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:08.996136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:08.996136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.020244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:09.021774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:09.032861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 175/365] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:09.077807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff224bc0-5a68-408e-9102-a6af59818b26 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.090456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff224bc0-5a68-408e-9102-a6af59818b26 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.100747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.101803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.102293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.102764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.120375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:09.130889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:09.132806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 191/366] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:09.138705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.149042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf965c1b-534c-436c-bab7-4bea803c1173 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.159442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.160809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.161286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.161772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.162859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:09.163386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.165192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.174648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 176/367] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.180431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.194688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf1657-07a3-418b-a434-11e026891a44 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.204001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.204910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.205412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.205880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.214979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.217057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.228600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 192/368] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:18:09.234861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.245489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5faede-8104-4b4b-bfd8-a4b8b5eb39f3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.255315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.256425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.257010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.257475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.258867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.261125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.263202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 177/369] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.269158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.278444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a954-8201-48dc-bcac-245331ee9c69 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.283334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.284411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.284916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.285381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.290651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.292776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f413b-44af-43e0-a97e-7bf42938bbbd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.295129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 193/370] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.301239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.312287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ff8df-2141-4e5a-aa00-67085cf31700 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.323559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.324522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.325011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.325571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.326710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=4aebba61657b49cab411fe2db3d11bfb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:09.327217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.329337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5311161-2bf8-4bdb-b826-5a68c9cc6a52 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.335875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 178/371] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:09.396446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d33e5-b160-4f6f-8e87-2147fd968d98 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.397147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d33e5-b160-4f6f-8e87-2147fd968d98 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.397644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d33e5-b160-4f6f-8e87-2147fd968d98 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.399740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 194/372] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:09.405539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.406131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.406603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.428356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:09.429953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:09.439292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 179/373] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:09.471916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d33e5-b160-4f6f-8e87-2147fd968d98 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.485353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d33e5-b160-4f6f-8e87-2147fd968d98 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.490215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.491324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.491808 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.492299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.515057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:09.522516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:09.523959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 195/374] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:09.530322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.539808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13876cb-6aeb-4de2-beeb-02b0b61f2ee7 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.553928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.554626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.554907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.555176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.555970 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:09.556277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.557966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.568777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 180/375] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.574828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.591555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60770a-ca4c-43ad-a5e7-93a5b4b0ce3f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.602863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.603983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.604462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.604951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.620035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.622111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.634859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 196/376] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:09.640944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.654471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eecf7-b1a2-47c8-a6a3-9edbbb261c41 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.662816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.663754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.664034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.664357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] PATH_INFO: `/v3/projects/c3f01046c2f74fba94104e65299e171f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.666682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] RBAC: Authorizing `identity:get_project(project_id=c3f01046c2f74fba94104e65299e171f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.668640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.671479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 181/377] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/projects/c3f01046c2f74fba94104e65299e171f => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.676636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.688413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03fae5-ea85-4247-adea-577f8b15a924 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.699663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.700910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.701391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.701858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] PATH_INFO: `/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.709208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] RBAC: Authorizing `identity:get_group(group_id=4c43ee5b45b04c81bf7e48ccfe4517da)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.711416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd179bdc-28e4-452b-889b-349bc984c290 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.713271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 197/378] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:09.720687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:09.731247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820e27-bc9d-4e66-9386-b4ef5f0fe72c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:09.739166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:09.739879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:09.740138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:09.740409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:09.741242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] RBAC: Adding query filter params (group.id=4c43ee5b45b04c81bf7e48ccfe4517da, role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=c3f01046c2f74fba94104e65299e171f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:09.741550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:09.743441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3886c3-c43d-4914-ac03-4e0c24b97169 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:09.752242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 182/379] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:09 2022] GET /identity/v3/role_assignments?group.id=4c43ee5b45b04c81bf7e48ccfe4517da&scope.project.id=c3f01046c2f74fba94104e65299e171f&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:10.748937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506ec5-09ab-4e2b-bca9-7f1060ad8974 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.749814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506ec5-09ab-4e2b-bca9-7f1060ad8974 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.750246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506ec5-09ab-4e2b-bca9-7f1060ad8974 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.752451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 198/380] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:10.757536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.758012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.758283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.781034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:10.782349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:10.795505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 183/381] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:10.831247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506ec5-09ab-4e2b-bca9-7f1060ad8974 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:10.849229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506ec5-09ab-4e2b-bca9-7f1060ad8974 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:10.853842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:10.854790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.855173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.855567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.867511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:10.875617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:10.877259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 199/382] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:10.882921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:10.892309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a60ab-f178-4ede-9d75-13bb4ed5798d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:10.896903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:10.897742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.898120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.898491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.899390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:10.899800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:10.901492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:10.910348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 184/383] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:10.915940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:10.926555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3dfcf-0d76-4d68-9c53-cd3cd062fa8d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:10.931144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:10.932161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.932540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.932908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.934353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:10.937101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:10.939079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 200/384] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:10 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:10.944590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:10.957210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b08f0-1476-45fa-8151-31d64f94069c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:10.961919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:10.962897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.963272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.963720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.965156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:10.968075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e01b4e-c60d-44f2-9a66-1afee4e358ac admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:10.970317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 185/385] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:10 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:10.976398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:10.988122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcb543-a8c9-4afa-9300-d1a85a8a5873 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:10.994854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:10.995955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:10.996382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:10.996788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:10.999241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, group_id=6cd2f4000e464abab67ffb6f2a4325eb, role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:11.002291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dd594-44d0-4023-b217-40fcdc01bef4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:11.083352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 201/386] 10.222.0.65 () {58 vars in 1463 bytes} [Mon Feb 21 09:18:10 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/25dd5c2d68ea41728022051659ca3b76 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:11.257005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7667e-487b-49b0-9e31-0199519905ce None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.257297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7667e-487b-49b0-9e31-0199519905ce None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.257581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7667e-487b-49b0-9e31-0199519905ce None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.259387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 186/387] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:11.266181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.266474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.266751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.291463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:11.292684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:11.369494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 202/388] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:11.402036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7667e-487b-49b0-9e31-0199519905ce None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:11.424092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7667e-487b-49b0-9e31-0199519905ce None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:11.433828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:11.434670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.434958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.435234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.448021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:11.460452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:11.461707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 187/389] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:11.468044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:11.485369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c0f8-b7bb-4d52-a677-2e6ecb01da56 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:11.495611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:11.496422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.496802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.497207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.498161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:11.498580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:11.500331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:11.514394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 203/390] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:11.522073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:11.542164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8817e36-d430-4080-beff-dc398b6853d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:11.553031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:11.554334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.554763 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.555175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.559005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:11.561412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:11.563991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 188/391] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:11 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:11.571084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:11.585814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b20be1-be17-47de-a82e-28d9afd814d1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:11.593938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:11.594816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.595064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.595365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.596612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:11.598663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae641a-ed0d-4e12-b186-88f00a92baea admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:11.604766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 204/392] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:11 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:11.610094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:11.624440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b212d8-7dab-46a8-99a5-c54e26f0ddc2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:11.631418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:11.632297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.632592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.632877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.640091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, group_id=6cd2f4000e464abab67ffb6f2a4325eb, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:11.643011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dff11-71b8-4b09-b5af-e3002c557256 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:11.757704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 189/393] 10.222.0.65 () {58 vars in 1463 bytes} [Mon Feb 21 09:18:11 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:11.772550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d394b2-65c9-41da-8afb-f4b5e66142e7 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.773183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d394b2-65c9-41da-8afb-f4b5e66142e7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.773183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d394b2-65c9-41da-8afb-f4b5e66142e7 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.775071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 205/394] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:11.794453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:11.794793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:11.795036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:11.822426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:11.823684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:11.938309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 190/395] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:12.013459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d394b2-65c9-41da-8afb-f4b5e66142e7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.031970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d394b2-65c9-41da-8afb-f4b5e66142e7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.043827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.043827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.043827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.043827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.058431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:12.066929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:12.068974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 206/396] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:12.074592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.089392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37fa98-bd28-4a9f-bb38-7502b7d29afb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.094397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.095325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.095826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.096312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.097253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:12.097798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.099732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.110260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 191/397] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.115553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.128263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f793d0-6601-4d26-a29f-0e7ccf6381e5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.134044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.135327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.135809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.136281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.137815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.140005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.142290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 207/398] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.149138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.160926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f9452-240b-4b5c-8092-19d6ca36356c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.171290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.172471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.172753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.173023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.174363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.176541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147e6f8-119f-49eb-82a9-44bdb3c96d57 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.178361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 192/399] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.184385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.203765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298323c-9c6f-4a7b-9786-c603ae34bc67 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.208375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.209263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.209542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.209814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.217311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e2e697281241be9e4ba20ab2539e1f, group_id=6cd2f4000e464abab67ffb6f2a4325eb, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.219996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c446b48-f27e-4880-8773-6bf1a6160410 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.312206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 208/400] 10.222.0.65 () {58 vars in 1463 bytes} [Mon Feb 21 09:18:12 2022] PUT /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:18:12.435237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46243-cafb-403c-82f5-1d222211bb7a None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.435237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46243-cafb-403c-82f5-1d222211bb7a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.435237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf46243-cafb-403c-82f5-1d222211bb7a None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.435237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 193/401] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:12.441230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d645c-6780-4396-8215-7345230b9bea None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.441542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d645c-6780-4396-8215-7345230b9bea None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.441789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d645c-6780-4396-8215-7345230b9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.470491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c99d645c-6780-4396-8215-7345230b9bea None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:12.471649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c99d645c-6780-4396-8215-7345230b9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:12.556134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 209/402] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:12.583633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf46243-cafb-403c-82f5-1d222211bb7a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.604059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf46243-cafb-403c-82f5-1d222211bb7a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.608913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.609733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.610011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.610280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.632439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:12.641528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:12.642489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 194/403] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:12.648278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d645c-6780-4396-8215-7345230b9bea None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.658164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d645c-6780-4396-8215-7345230b9bea None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.665782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.666458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.666736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.667029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.667794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:12.668100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.669960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.679415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 210/404] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.685851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.696701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988348-ab38-401a-be4d-8d5b959eb3aa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.701999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.703013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.703328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.703655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.705667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.707770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.709707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 195/405] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.715142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.726531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9451-8026-4288-ba80-c0a5a1bffeb6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.735328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.735328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.735328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.735328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.737017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.739549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e8ffa-401d-43a9-83a6-4f973f4db7c5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.741788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 211/406] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:12 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:12.748752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:12.764939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947012d5-a383-4736-8cf3-53add704ef5d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:12.771748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:12.772624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.772908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.773183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.781150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aebba61657b49cab411fe2db3d11bfb, group_id=6cd2f4000e464abab67ffb6f2a4325eb, role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:12.783819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:12.860376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a523-1943-4ca0-b6fe-25ebd992870c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.861454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a523-1943-4ca0-b6fe-25ebd992870c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.861966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300a523-1943-4ca0-b6fe-25ebd992870c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.863949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 212/407] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:12.870502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:12.871047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:12.871617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:12.879998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 196/408] 10.222.0.65 () {58 vars in 1463 bytes} [Mon Feb 21 09:18:12 2022] PUT /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb/groups/6cd2f4000e464abab67ffb6f2a4325eb/roles/25dd5c2d68ea41728022051659ca3b76 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:12.898587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:12.902477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:12.986546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 213/409] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:13.022693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:13.036628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d50e9-4539-463c-b7c8-ad347ad513b5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:13.046361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:13.047173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:13.047480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:13.047754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:13.066421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:13.073649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:13.075086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 197/410] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:13.081627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:13.091634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02480625-06b4-49fd-89ce-ee2e434bd88e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:13.101019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:13.102033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:13.102533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:13.103080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:13.104092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:13.104594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:13.106481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:13.119893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 214/411] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:13.125623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:13.143502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e495650-bb41-4af1-a44b-377cf7b64f96 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:13.152901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:13.154448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:13.154735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:13.155005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] PATH_INFO: `/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:13.160063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] RBAC: Authorizing `identity:get_group(group_id=4c43ee5b45b04c81bf7e48ccfe4517da)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:13.162015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:13.164039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 198/412] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:13 2022] GET /identity/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:13.169337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:13.185072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b953e3-00e9-459b-8a41-812ed0805170 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:13.190329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:13.195580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:13.196173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:13.196682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] PATH_INFO: `/v3/projects/c3f01046c2f74fba94104e65299e171f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:13.198275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3f01046c2f74fba94104e65299e171f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:13.207631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653fbda-b6fa-495d-ac48-a22305196587 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:13.209877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 215/413] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:13 2022] GET /identity/v3/projects/c3f01046c2f74fba94104e65299e171f => generated 344 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:13.215549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:13.234876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fae870-f343-4500-8882-4996ed50007b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:13.243822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:13.244663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:13.244926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:13.245202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] PATH_INFO: `/v3/projects/c3f01046c2f74fba94104e65299e171f/groups/4c43ee5b45b04c81bf7e48ccfe4517da/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:13.252877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f01046c2f74fba94104e65299e171f, group_id=4c43ee5b45b04c81bf7e48ccfe4517da, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:13.255594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abb710-a2e0-42bc-90d4-b23646a4d02a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:13.335841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 199/414] 10.222.0.65 () {58 vars in 1463 bytes} [Mon Feb 21 09:18:13 2022] PUT /identity/v3/projects/c3f01046c2f74fba94104e65299e171f/groups/4c43ee5b45b04c81bf7e48ccfe4517da/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:14.341822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e813c-7c14-4c75-9b82-4d5231595ac6 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.342835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e813c-7c14-4c75-9b82-4d5231595ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.343531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e813c-7c14-4c75-9b82-4d5231595ac6 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.345878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 216/415] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:14.351125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.352096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.352570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.374627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:14.376212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:14.456532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 200/416] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:14.493700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e813c-7c14-4c75-9b82-4d5231595ac6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.506408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e813c-7c14-4c75-9b82-4d5231595ac6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.510958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.516292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.516800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.517301 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.529105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:14.536626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:14.538396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 217/417] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:14.543964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.553191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f71b1-6438-424b-9f06-b2d9b7ee7af1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.560870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.561766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.562256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.562724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.563722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:14.564222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:14.566009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:14.575783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 201/418] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:14.581004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.593655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04961c-ffe6-4ad2-a282-a97a47fefad6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.598269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.598901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.599180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.599533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.611026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:14.612879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:14.622469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 218/419] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:14.627925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.638277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc633b62-e67d-4d1e-9424-03f485e47b89 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.643143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.644081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.644414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.644691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.645940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:14.648069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:14.650012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 202/420] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:14.655882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.666259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fa-f1b0-458a-b1b8-a59d13801942 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.673768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.674673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.674954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.675228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.676470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:14.678465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b203ae4-d8ac-42b0-827a-ac0714ecb1df admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:14.680430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 219/421] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:14.686757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.696751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7353b3-ad53-4b4d-b250-9fb82a0ae68b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.702776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.703479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.703761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.704089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.705012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:14.705507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:14.707515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7b16c-008c-4f0c-a4f3-99be90160fac admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:14.714315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 203/422] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:14.888555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2dc-225e-49e7-a0c7-eedbb1c3e7e1 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.888897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2dc-225e-49e7-a0c7-eedbb1c3e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.889016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1a2dc-225e-49e7-a0c7-eedbb1c3e7e1 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.891331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 220/423] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:14.896904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.897197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.897473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.919221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:14.920556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:14.929146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 204/424] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:14.957570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a2dc-225e-49e7-a0c7-eedbb1c3e7e1 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:14.970831 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1a2dc-225e-49e7-a0c7-eedbb1c3e7e1 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:14.975857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:14.976649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:14.976927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:14.977199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:14.990117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:14.997770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:14.999369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 221/425] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:15.005157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.017179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993fb9a-1b5e-4a29-b913-e9f657bfd447 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.025178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.025857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.026140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.026418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.027175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.027508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.029158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.042551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 205/426] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.048195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.063639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766b1d8-a245-4587-99bb-b87dfb0935d4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.071125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.072166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.072668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.073151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.085196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.087236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.100142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 222/427] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:15.105031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.120301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2197-28eb-4550-b0e2-7a733319db21 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.127437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.128297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.128579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.128852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.132038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.134105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.136139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 206/428] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.142227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.153492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927900b9-6d01-4224-97aa-69d463e24aad admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.160761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.161883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.162317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.162758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.164163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.166360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2094-ed73-4600-85db-1ecdea8dbff6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.173742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 223/429] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.175270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.189682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e6b05-7010-43e6-bb19-da3875134eff admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.194580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.195552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.195995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.196373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.197318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=4aebba61657b49cab411fe2db3d11bfb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.197785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.199890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1c5c-805a-46e6-bf17-7da6b9b72f42 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.206892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 207/430] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.620753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f87c8a-8279-4a75-8986-42f5b37388fa None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.621699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f87c8a-8279-4a75-8986-42f5b37388fa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.622214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f87c8a-8279-4a75-8986-42f5b37388fa None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.624509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 224/431] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:15.630047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513296b1-6f9b-4ebe-b724-339a2b1bb65b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.630494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513296b1-6f9b-4ebe-b724-339a2b1bb65b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.630669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513296b1-6f9b-4ebe-b724-339a2b1bb65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.648868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-513296b1-6f9b-4ebe-b724-339a2b1bb65b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:15.650076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-513296b1-6f9b-4ebe-b724-339a2b1bb65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:15.658724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 208/432] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:15.682824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f87c8a-8279-4a75-8986-42f5b37388fa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.687425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a5ff-4df4-48c6-af03-cc0d14270364 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.687718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a5ff-4df4-48c6-af03-cc0d14270364 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.687991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a5ff-4df4-48c6-af03-cc0d14270364 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.690136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 209/433] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:15.696135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f87c8a-8279-4a75-8986-42f5b37388fa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.696651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.697033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.697420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.700682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.701472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.701759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.702036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.716219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:15.717402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:15.718928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:15.725022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 210/434] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:15.727103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:18:15.728836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 225/435] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:15.736033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.746255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890350-2c4a-4883-b0f4-ee2579fcc2e3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.751169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.752954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.753274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.753984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.754707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.756191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.756964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.759764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.763819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16269cdb-4fee-4eea-a84f-a728ff8ee946 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.769153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.769606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.769897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.770233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.773023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 211/436] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:15.778800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.784212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:15.789310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d99fd-9a53-4292-960f-79bab2e2c71f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.793891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:15.794805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.795553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.795832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.796265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 226/437] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:15.796366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.801517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.809056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.810774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a6bc2-cfc6-4598-8a62-b4c18c4a649b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.810888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.815102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.815768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.816054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.816338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.817073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.817383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.818959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.819748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 212/438] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:18:15.826080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.827979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 227/439] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:15.833098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.835458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397985c-52ea-440d-b89c-f1c40bc9419e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.841531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.842711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.842929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7c4f-b734-453f-99d6-17a63e142046 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.843287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.843728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] PATH_INFO: `/v3/projects/d5e2e697281241be9e4ba20ab2539e1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.845241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5e2e697281241be9e4ba20ab2539e1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.847402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.847857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.848021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.848311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.848591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.850092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 213/440] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/projects/d5e2e697281241be9e4ba20ab2539e1f => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:15.855467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.856607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.858369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.866214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843a6b3-2d01-40d6-a2d6-ecc1ed413a76 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.867144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 228/441] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:18:15.871853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.872682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.872944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.873046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.873233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.874396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.876514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.878919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 214/442] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.881193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b42ea7-f44c-4725-b223-0c8bacfe3d8a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.884700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.885648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.886474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.886760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.887041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] PATH_INFO: `/v3/projects/4aebba61657b49cab411fe2db3d11bfb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.888818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] RBAC: Authorizing `identity:get_project(project_id=4aebba61657b49cab411fe2db3d11bfb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.891103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.892764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 229/443] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/projects/4aebba61657b49cab411fe2db3d11bfb => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:15.896613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266240d3-7d2f-4802-8fb0-ff84e8ddf016 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.898979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.901044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.901668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.901951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.902226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.903039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=588f5e2f6b5c466bafbf0fe06ec211aa, scope.project.id=d5e2e697281241be9e4ba20ab2539e1f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.903991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.906555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.908787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842f5e-3bc0-46d2-9dcb-ea13e2f90d34 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.919412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 215/444] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=d5e2e697281241be9e4ba20ab2539e1f&role.id=588f5e2f6b5c466bafbf0fe06ec211aa => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:15.919594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.919594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.919594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.919594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] PATH_INFO: `/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.919870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] RBAC: Authorizing `identity:get_group(group_id=6cd2f4000e464abab67ffb6f2a4325eb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.919870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe403151-5668-4acd-8bbd-0c63a2e82e3a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.919870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 230/445] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/groups/6cd2f4000e464abab67ffb6f2a4325eb => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:15.925291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:15.935492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4052-5488-40a2-b223-f8b9cb124b18 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:15.940083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:15.940761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:15.941045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:15.941323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:15.942309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] RBAC: Adding query filter params (group.id=6cd2f4000e464abab67ffb6f2a4325eb, role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=4aebba61657b49cab411fe2db3d11bfb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:15.942633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:15.944582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2361ca-4625-4ac5-9c35-cdb26259c005 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:15.951905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 216/446] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:15 2022] GET /identity/v3/role_assignments?group.id=6cd2f4000e464abab67ffb6f2a4325eb&scope.project.id=4aebba61657b49cab411fe2db3d11bfb&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:16.571122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fcde-4706-409e-a12e-5309da15d62b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.571521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fcde-4706-409e-a12e-5309da15d62b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.573091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475fcde-4706-409e-a12e-5309da15d62b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.574945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 231/447] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:16.580932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.581221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.581495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.599359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:16.600549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:16.609494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 217/448] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:16.632995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475fcde-4706-409e-a12e-5309da15d62b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.645595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475fcde-4706-409e-a12e-5309da15d62b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.649842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.650610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.650892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.651164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.661918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:16.668674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:16.670388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 232/449] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:16.676091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.685598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b8b70-4daa-42f4-bf14-d040e78f1448 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.690202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.690871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.691157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.691469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.692230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:16.692538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:16.694134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:16.702588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 218/450] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:16.708039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.717697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387431c-b6d7-4d90-b455-f7d6baf881fc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.722037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.722676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.722962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.723237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.733200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:16.734156 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:16.745745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 233/451] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:16.752011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.761932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee560901-33c9-41ca-9f52-1fa5c146a8f1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.766513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.767383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.767672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.767948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] PATH_INFO: `/v3/projects/c3f01046c2f74fba94104e65299e171f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.769116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] RBAC: Authorizing `identity:get_project(project_id=c3f01046c2f74fba94104e65299e171f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:16.770899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:16.772592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 219/452] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/projects/c3f01046c2f74fba94104e65299e171f => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:16.778382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.787099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d0d42-5d2e-452f-aaa8-059bcc4a2a37 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.791456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.792277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.792558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.792832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] PATH_INFO: `/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.794518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] RBAC: Authorizing `identity:get_group(group_id=4c43ee5b45b04c81bf7e48ccfe4517da)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:16.796418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a219b5-c234-4bd4-aa2b-40427d3c58fe admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:16.797936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 234/453] 10.222.0.65 () {56 vars in 1201 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/groups/4c43ee5b45b04c81bf7e48ccfe4517da => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:16.803226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:16.813001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e3209-0622-4e06-ac19-6fe351dfdfae admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:16.817288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:16.817897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:16.818181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:16.818459 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:16.819267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] RBAC: Adding query filter params (group.id=4c43ee5b45b04c81bf7e48ccfe4517da, role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=c3f01046c2f74fba94104e65299e171f) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:16.819611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:16.821445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d2e57-969f-4bcc-b479-7297ef28d954 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:16.826900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 220/454] 10.222.0.65 () {56 vars in 1397 bytes} [Mon Feb 21 09:18:16 2022] GET /identity/v3/role_assignments?group.id=4c43ee5b45b04c81bf7e48ccfe4517da&scope.project.id=c3f01046c2f74fba94104e65299e171f&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:19.690914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a745a-4fdf-4718-9df3-d4ada8a25967 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.691471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a745a-4fdf-4718-9df3-d4ada8a25967 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.691549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a745a-4fdf-4718-9df3-d4ada8a25967 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.693499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 235/455] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:19.698797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.699194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.699398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.721430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:19.722630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:19.735416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 221/456] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:19.751276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29ee8-af4b-4462-b70b-50f302359dff None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.751634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29ee8-af4b-4462-b70b-50f302359dff None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.751886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da29ee8-af4b-4462-b70b-50f302359dff None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.753794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 236/457] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:19.759983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:19.763463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.763756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.764032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.769644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073d739-a4db-4f7c-b187-54789e37e753 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:19.774388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:19.775277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.775594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.775872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.786629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:19.788521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:19.800370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:19.801939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:19.807847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:19.810247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 222/458] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:19.815318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:19.817460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 237/459] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:19.827119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c231a2-f1fc-4772-8e20-d17d486268c3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:19.831420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:19.832060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.832346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.832619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.833338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:19.833646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:19.835255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:19.847373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 223/460] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:19.852402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:19.858883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:19.868051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f76585-92a4-41c4-8ad3-3aa04e94a349 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:19.875149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140056fd-c704-40a5-a244-639d8d1a27c7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:19.877611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:19.878278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.878558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.878832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.879573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:19.881481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a1568-5512-4afb-897f-0f63d6ebe5c4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:19.892954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:19.893757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.894037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.894319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.908237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:19.910113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:19.929508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:19.931105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 224/461] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:19.937627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:19.947793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9ba77-419a-42c5-9181-f5dea15d0131 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:19.952480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:19.953187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:19.953471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:19.953745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:19.954465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:19.954770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:19.956464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:19.970075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 225/462] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:19.982303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 238/463] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:19 2022] POST /identity/v3/users => generated 248 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:19.982775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.000834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca3015-a654-4896-a4e8-173ed69b9843 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.007249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.007957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.008237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.008509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.009323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.011444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.074821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de997a2-cbc5-4c41-8563-8f127dffb60d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.075166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de997a2-cbc5-4c41-8563-8f127dffb60d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.075520 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de997a2-cbc5-4c41-8563-8f127dffb60d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.078056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 239/464] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:20.084119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.084457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.084743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.091465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 226/465] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:19 2022] POST /identity/v3/users => generated 246 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:20.112594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:20.113879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:20.125260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 240/466] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:20.172897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.183517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77173ea-1564-4b7e-aa72-b661aee2163c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.195237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.196237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.196526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.196805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.214680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.217281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.242637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:20.248439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 227/467] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:20.254125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.265989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c7128-ec2d-42af-b03f-ced3570068ea None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.273186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.275954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.275954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.275954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.275954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:20.275954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.276467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:20.276467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:20.276467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:20.277278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81f784-9abb-4a80-9616-029ab9a03e7a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.297757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 241/468] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:20.303570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.313805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6c280-f71c-48f5-98a8-53817d8aad9d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.319026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5936c-0083-44f3-94f5-40fd1b763f9c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.319334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5936c-0083-44f3-94f5-40fd1b763f9c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.319620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5936c-0083-44f3-94f5-40fd1b763f9c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.321565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 242/469] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:20.323039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.323751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.324094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.324370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.325705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.327879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.329146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.329720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.330196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.352578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:20.353935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:20.362950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 243/470] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:20.389020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.399045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e661d-55aa-4ab8-a895-7f3e6e225a22 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.404269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.405115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.405443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.405735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.418233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.420209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.439143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:20.440942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 244/471] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:20.446371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.457704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa79657-430f-48d3-891b-86612a63d0c4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.462236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.462925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.463220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.463541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.464327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:20.464634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.466795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153c928-89cf-4346-90bb-45f2202d73bc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.478187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 228/472] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:20 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:20.482384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 245/473] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:20.488260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:20.509156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaf147-7d8a-4fc9-84d6-b83f70bf47c7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:20.518551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:20.519251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:20.519572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:20.519853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:20.520580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:20.522584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f884f1-a766-4e30-a551-81f4faa5e657 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:20.661531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 229/474] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:20 2022] POST /identity/v3/users => generated 249 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:21.165873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd759e1-7d8a-45c1-8dfe-402012d35115 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:21.166387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd759e1-7d8a-45c1-8dfe-402012d35115 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:21.166463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd759e1-7d8a-45c1-8dfe-402012d35115 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:21.168335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 246/475] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:21.174373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:21.175210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:21.175719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:21.203163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:21.204740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:21.213063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 230/476] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:21.236756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd759e1-7d8a-45c1-8dfe-402012d35115 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:21.250145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd759e1-7d8a-45c1-8dfe-402012d35115 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:21.254853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:21.255825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:21.256364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:21.256858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:21.257810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:21.259641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:21.300773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.sql.core [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 21 09:18:21.300773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 21 09:18:21.300773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [parameters: {'id': 'e4effed73b5f4b81b49d245203bf115e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 21 09:18:21.300773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:18:21.316483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 21 09:18:21.318037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 247/477] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:18:21 2022] POST /identity/v3/roles => generated 144 bytes in 82 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:21.323759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:21.335845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c0093-6cd1-43fa-beb2-cdd2c0075679 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:21.348614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:21.349429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:21.349711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:21.349983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:21.364735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:21.375662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d315acaf-6205-4674-8cef-9873159f8d5c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:18:21.377168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 231/478] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:21.382603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:21.403340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9e7f2-7643-4aae-b1f4-6da33c2b4456 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:21.408578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:21.409488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:21.409975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:21.410475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:21.411461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:21.411973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:21.413905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04e64-32dc-4ac4-bb8d-47539ad63fe7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:21.428252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 248/479] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:22.838927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba0bc-a752-4a79-8521-be923bd62cc8 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:22.839977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba0bc-a752-4a79-8521-be923bd62cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:22.840467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba0bc-a752-4a79-8521-be923bd62cc8 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:22.843574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 232/480] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:22.849505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:22.849975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:22.850054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:22.877207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:22.878431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:22.886618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 249/481] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:22.911525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba0bc-a752-4a79-8521-be923bd62cc8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:22.929847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba0bc-a752-4a79-8521-be923bd62cc8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:22.937015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:22.937835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:22.938118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:22.938397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:22.958284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:22.965270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:22.966843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 233/482] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:22.972415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:22.981644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c321e-e2bf-4e8f-b7ea-037d9dd708ab None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:22.991469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:22.992143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:22.992426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:22.992705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:22.993454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:22.993764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:22.995374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.006957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 250/483] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.012261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.028277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492435-73da-43f3-b9d8-32d2c16de1ea admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.036510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.037297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.037578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.037847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.051506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.053362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.073304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.074658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 234/484] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.081071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.097298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8460-62d2-4795-a28b-c2b4a2874553 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.112875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.113929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.114421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.114942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.115913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.116443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.118266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.136561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 251/485] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.143154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.156203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b23300-ed93-47fc-a13c-e6f818b4fbe9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.163371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.164161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.164444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.164718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.184992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.187022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.201223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-9bdb8b81-40fd-4cf5-aa03-cd2d8bb24748 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:23.202802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 235/486] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.208330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.220795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdbd25-572a-4f1b-b789-aeb4f5e20652 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.231178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.231947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.232236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.232565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.233409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.233774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.234797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:23.234797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:23.234797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:23.236029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.253609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7ea2-176b-4f3c-9f04-865a408577dd None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.253898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7ea2-176b-4f3c-9f04-865a408577dd None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.254176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df7ea2-176b-4f3c-9f04-865a408577dd None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.256253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 236/487] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:23.261044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.261329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.261607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.285386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 252/488] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.290793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.301169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcc6d-0e3f-4aaf-aca8-36a0c8080e95 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.303772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:23.305042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:23.306472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.307368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.307836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.308291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.318024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.320448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451809-06f4-401e-af5c-4f7349b3363e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.329004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 237/489] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:23.335395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 253/490] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:18:23.340890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.352586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98281-5946-4176-877a-2b0783f64def None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.352812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98281-5946-4176-877a-2b0783f64def None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.353096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b98281-5946-4176-877a-2b0783f64def None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.355272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 254/491] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:23.359156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb087f-675e-4adc-845d-6dd1248d4d73 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.361092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.361377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.361652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.370423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.371489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.372529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.372987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.380508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:23.381713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:23.390364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.392707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.395623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 255/492] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:23.396619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.406089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3db75-4cf5-4472-98bb-67cccbae1817 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.411474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.413299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 238/493] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.418042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.419458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.419742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.420015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.420426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.430541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d88d9-7ec9-4f97-95af-13623324dd42 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.435977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.436861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.437279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:23.437522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.437980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.438878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.439414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.441192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.450523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:23.451628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 256/494] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.452813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.454396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 239/495] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.459686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.463136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da609830-ebf5-46d9-8ec8-bad280614a5e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.467631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.468469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.468759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.469036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.470056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71fded-f075-4d94-b8f2-2cfd36c8dacc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.474616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.475663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.476144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.476611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.479897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:23.484521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.486684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.487284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:23.488474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 257/496] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:23.492090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.501964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-9191b829-572b-4399-8fb4-ea4ebe4daca6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:23.502202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02edf-f479-44f4-b581-297326762ddb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.503651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 240/497] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.504793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee07f-4b2d-435e-9c95-ccbb387124b0 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.504925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee07f-4b2d-435e-9c95-ccbb387124b0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.506105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee07f-4b2d-435e-9c95-ccbb387124b0 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.506858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 241/498] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:23.511524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cee07f-4b2d-435e-9c95-ccbb387124b0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.511634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.512247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.512566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.512841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.513593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.513903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.515536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.523439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cee07f-4b2d-435e-9c95-ccbb387124b0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.524398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 258/499] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.525183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.527704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.528372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.528657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.528919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.529659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.529963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.531570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228efd53-6004-4436-b09e-edca51b988c7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.534407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338d35-6745-4266-99d2-2aa920a4a2c3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.539073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.544266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 242/500] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.544380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.544380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.544380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.544559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.544559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.544697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.544772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.544846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.544846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:23.544846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:23.544846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:23.544846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.561889 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:23.562740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 259/501] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.563160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:23.568114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.570814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 243/502] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:23.579904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880864-d30d-4f17-913d-0812bb58cc30 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.580495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.586608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.587524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.587914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.588291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.594524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2d965-a127-4201-bb42-dd732fe76aeb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.599958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.600788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.601719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.601833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.602437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.602911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.614150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.615995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.618412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.619510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 260/503] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.620280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.629947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aff8a4-d197-45b6-86ad-143107b39101 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.632973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.638456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 244/504] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.638566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.638566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.638736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.638804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.638804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.638804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.638804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.638804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.651496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 261/505] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.651496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.657478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966dd2a-fcf5-4ca0-acfe-da15152a2902 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.661519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d959a3-3985-4f98-af65-c0ddbc7e3601 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.662300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.663170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.663491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.663770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.667245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.668245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.669253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.669715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.670647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.671136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.672988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.678054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:23.686789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:23.688718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 245/506] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.689724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.693941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 262/507] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.695045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.701560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc784ce4-5f7d-4410-a19e-ba1331ba7456 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.705638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ba37d-624a-4413-9796-56efe3dcc0ee admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.706072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.706731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.707019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.707317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.708088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.708379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.710336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.712030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.713036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.713583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.714048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.715048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.716146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.718152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.724174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 246/508] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.724830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.733621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 263/509] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.734924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.735188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587566-eeb8-4286-b71f-148d35ffd517 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.739796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.740617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.740901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.741176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.747482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddaad1-93cb-4415-af3e-2e6b98862105 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.749406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.751464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.753188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.754302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.754856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.755368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.764160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.766759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:18:23.767555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.768362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 247/510] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.769180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.783137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230e886-4b0a-49b1-b65d-395a70bb9571 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.786169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:18:23.787461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 264/511] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.788246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.789145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.789998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.790289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.790893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.799448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ed036-2493-430d-85cc-0b71d995e030 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.804760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.805355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.806039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.806335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.806615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.806874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.807509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.807824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.810006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.831150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.832613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 248/512] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.833264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.843794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22c22-f35f-4d3c-8d5d-44cb9f70b8a0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.844615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 265/513] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.845218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.852629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.853365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.853594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.853867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.854711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.855013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.856072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:23.856072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:23.856072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:23.858681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.861395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc1f9-9d25-494c-978a-a1af61ef26db admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.866893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.867596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.867888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.868211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.869329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.869798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.872429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.888152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 266/514] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.889122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.897619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 249/515] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:23.898311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.902875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cfd14-4836-4e1d-ac36-8c4f5c048b00 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.908478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df0587-e427-40e1-a7b6-a2edbb0fca65 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.910449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.911492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.911759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.912028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.913176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.913962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.914276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.914551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.921158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.922920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.923100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.925187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.932307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 267/516] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:23.933104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.942261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25e3e8-efae-496f-929f-6bf80fa7d1f3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.943729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:18:23.944949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 250/517] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.945713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.947265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.948000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.948284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.948563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.955286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b82f0-6d71-4fa1-a719-394aca0310c0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.957175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.959373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.959753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.960499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.960777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.961046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.969525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 268/518] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:23.970316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:23.972438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.974566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.979883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1cfc0-2b97-4913-b7e7-19134403756d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:23.986085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:23.986740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:23.987027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:23.987329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:23.988340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:23.988877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:23.991911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:23.992962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:23.994344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 251/519] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:23.994942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.008901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4ad6f-de0f-4aab-84f4-8509a3de7ddb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.013483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 269/520] 10.222.0.65 () {56 vars in 1160 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.013984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.014336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.014816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.015128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.015387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.026027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.026541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7396d-90a0-4e2a-a78c-46ba597a28be admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.027919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.032592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.033257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.033590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.033871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.034653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.034970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.037607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.045763 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:24.047243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 252/521] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.048041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.050634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 270/522] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.053236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.061728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105047-da94-4d80-bd41-688cbb355ef6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.064248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87ed4-90b4-4019-9f5d-bb35b88ee50c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.066327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.067009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.067325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.067592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.069022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.069668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.069953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.070232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.070950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.071260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.073132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.076620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.078484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.087742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 253/524] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:24.087957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 271/524] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:24.088548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.093515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.100670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad7939-6f06-46ea-95d3-3d42ee375143 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.104948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266ae00-394f-42c6-a26d-6f79765841bb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.105852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.106969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.107578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.108074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.110996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.112844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.113134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.113407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.117780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.120016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.120833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.122813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.134653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:24.136203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 254/525] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.136690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:24.137326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.143556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 272/526] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.144545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.149360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cfec5-912d-4bfa-aa8e-6f3bab1f3091 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.154810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.155830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248a45-3194-4c4f-9a68-3a40bbdafc5f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.156028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.156470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.157041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.160642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.161354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.161704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.162050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.162889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.163282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.165292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.169771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.171972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.177708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 273/527] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.178676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.188604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de268-f4fc-4e1d-9a8f-65e220d3c133 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.190580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:24.192531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 255/528] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.193622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.198553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.200882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.201340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.201798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.204576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.205074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.208396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.211523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439a09-70be-4713-becb-daf5a09c7d51 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.219067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.220260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.220768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.221789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.222653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=cac705ffe7884b0db365621e8bd286cc) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.223131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.225197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.225673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 274/529] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.226661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.237168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 256/530] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/role_assignments?user.id=cac705ffe7884b0db365621e8bd286cc&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.238053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.238608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865783-3d63-48dc-b43d-157ed734182d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.243613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.244907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.245433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.246610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.248036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.248588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.249809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e983c62-421b-4c60-8c3a-f6410f61dcbc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.250763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.255287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.255972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.256261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.256541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.257371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=8225ba8ede944425a2b21bb4eeb8ec10) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.257689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.259561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.267777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 275/532] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.272479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 257/532] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/role_assignments?user.id=8225ba8ede944425a2b21bb4eeb8ec10&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.273895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.293161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611bcf-a532-4dd7-9954-12af4c7cb61e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.299474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.300737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.301290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.301768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.315428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.317967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.340109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:24.342326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 276/533] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.348753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.360045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a0972-7c80-43f7-a3f5-4e2b843c9567 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.365490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.366653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.367190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.367725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.368893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.369543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.370955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:24.370955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:24.370955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:24.372651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf949d-b57e-4693-b628-a75b07706c00 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.395950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 258/534] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.402208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.413495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fff6a-8196-4fc0-bafe-fc259242aa70 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.425722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.426836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.427508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.427986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.429105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=3db3df5c19dd4331a2c85d3a10bcb0f4) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.429707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.431961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659c860-d403-4da1-8ad9-2ea8230f13cd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.444666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 277/535] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/role_assignments?user.id=3db3df5c19dd4331a2c85d3a10bcb0f4&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.742560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae361-3580-4509-8a72-283e5e9a1d59 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.742848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae361-3580-4509-8a72-283e5e9a1d59 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.743072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaae361-3580-4509-8a72-283e5e9a1d59 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.745170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 259/536] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:24.751200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.751525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.751803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.771988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:24.773317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:24.781338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 278/537] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:24.805556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae361-3580-4509-8a72-283e5e9a1d59 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.822437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaae361-3580-4509-8a72-283e5e9a1d59 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.832451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.833238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.833519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.833791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.846871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.848778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.869375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:24.870717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 260/538] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:24.877775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.886785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b3c29-a011-4d6f-b6ad-88f6253d8baf None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.895439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.896095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.896380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.896659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.897379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:24.897686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.899275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaed33-2f9d-47be-95fa-635c9b20b099 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:24.911181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 279/539] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:24.916709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:24.927135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35ae7-86a9-4cd1-b551-0471d651b511 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:24.931838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:24.932494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:24.932782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:24.933119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:24.933839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:24.936536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e29d-274b-4385-9c8f-30fb2e3f57d2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:25.067113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 261/540] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:24 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:26.501102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e33b-4f4f-4116-b716-25463ab17247 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.501794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e33b-4f4f-4116-b716-25463ab17247 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.502065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e33b-4f4f-4116-b716-25463ab17247 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.504890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 280/541] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:26.513478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.514043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.514043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.545282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:26.546538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:26.558952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 262/542] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:26.603691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e33b-4f4f-4116-b716-25463ab17247 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.620113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e33b-4f4f-4116-b716-25463ab17247 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.630719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.631547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.631835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.632112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.648567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:26.656259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:26.657774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 281/543] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:26.664576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.676244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1a92-42cb-4b6a-b1da-42a80aa385ef None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.687969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.688658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.688950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.689232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.690000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:26.690311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:26.691995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:26.701512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 263/544] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:26.707081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.720217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e6844-42cb-4321-8919-c96face8bd97 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.727482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.728271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.728555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.728830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.747581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:26.749428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:26.774127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:26.775577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 282/545] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:26.780900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.796840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2671-025f-4a16-9df0-b2e815e6b442 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.812590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.813274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.813563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.813845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.814580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:26.814894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:26.816563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:26.840990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 264/546] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:26.846314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.860515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba89ee-a117-4875-a901-ef18d6474a57 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.867788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.868614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.868901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.869176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.884545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:26.886626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:26.911190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a83e9360-b1fd-4ccd-aa6a-f200b6f87e54 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:26.912823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 283/547] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:26.918328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.933035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f92b68-af6e-48a0-96e2-58e753de6611 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:26.947947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:26.948633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.948921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.949203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.950727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:26.951041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:26.952943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:26.971505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575f01-abcd-48e2-a141-b020ce9008ea None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.971807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575f01-abcd-48e2-a141-b020ce9008ea None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.972093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575f01-abcd-48e2-a141-b020ce9008ea None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.974190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 284/548] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:26.979629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 265/549] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:26.979832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:26.979832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:26.979832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:26.982843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:26.992800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644e413-4e15-4c98-8985-bf40c5f70b82 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.004130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.004930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.005208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.005480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.008570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:27.009969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:27.025491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 285/550] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:27.032233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.034106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.047818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.056501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:27.057814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 266/551] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.062814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c57fe-6575-4fa7-830b-0790df9f9133 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.063869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.073993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.074790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.075690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.075969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.078719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf10fc-1e77-4f02-a869-8126c3ad0882 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.092825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.093476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.093758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.094033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.094757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.095064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.096722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.098786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:27.107488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:27.108703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 286/552] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.118544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.125813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 267/553] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.136260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df9329-3a60-4bf2-9c59-e2ee7ff9799d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.136654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.141169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.141823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.142102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.142509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.143269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.143618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.145222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.153977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d832-84fb-44f1-ac45-95f34acf7706 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.154557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 287/554] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:27.158845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.159702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.159985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.160151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.160301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.170120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f409b-4961-44b9-ae6c-ef6659f53540 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.176766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.176766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.176766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.176766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.177686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.180047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.187502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.189362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.207876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:27.208615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:27.214092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 288/555] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.215499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.215922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 268/556] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:27.231987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a018a-1816-4428-972f-212d15c3b7d0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.234408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.241397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.242088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.242370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.242646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.243422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.243737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.247437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8e531-8230-4c25-9dbb-760ee45b19df admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.256946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210f128-c172-495d-9682-1c8642f1fa00 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.261560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.262222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.262599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.262909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.263734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.264100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.265503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 289/557] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:27.266386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fb883-8909-4e20-9540-1346ec054124 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.267229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7079-5b47-4700-bcbd-a3d7af5ef8e6 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.267548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7079-5b47-4700-bcbd-a3d7af5ef8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.267829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7079-5b47-4700-bcbd-a3d7af5ef8e6 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.270116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 290/558] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:27.271125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7079-5b47-4700-bcbd-a3d7af5ef8e6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.281103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 269/559] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.282784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.283208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.283643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.292944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7079-5b47-4700-bcbd-a3d7af5ef8e6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.304168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.305116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.305402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.309870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.311021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:27.312487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:27.315716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.318237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.323331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 270/560] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:27.324353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.333940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05575-cd59-4d4f-b6cd-4e18d71fc523 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.334556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:18:27.340737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 291/561] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:27.342111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.342803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.344103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.344579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.344996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.353506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ce2e-63d6-425a-b082-3e8b89279891 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.360389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.361492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.361818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.362245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.363152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.363344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=e7eb5c189bbd41449e3478b7dfcb27fb, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.363666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.365596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.366787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.387877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 292/562] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:27.388970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.399633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a441-d950-408c-832e-131437b8633a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.404544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.405673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.405961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.406241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.427402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 271/563] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:27 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:27.427402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.439583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:27.451926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:27.456010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 293/564] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.468403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.489895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937dbc9-b02c-4751-a400-d9d64af0b9e0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.520303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21e114-7284-4656-a772-6d5752537026 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.537473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.538235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.538483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.538778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.568547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.570443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.574124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.575585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.576076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.576603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.577640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.578175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.583148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.594416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 294/565] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.600831 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.612560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7444b-953f-4792-a214-ba78595ac04e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.615987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:27.621687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 272/566] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.623865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.625047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.625629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.626113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.640179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.640386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.642978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.657865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e98b-b0a9-4bd4-9b48-7d667a37f753 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.662588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.663266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.663580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.663858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.664641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.664954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.666656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e5ffb-c158-4ae6-b265-5a3b5a657c69 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.667751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-cb587d32-cd0a-40a6-b783-1def5ef806f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:27.670783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 295/567] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.672534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd467-ae11-420b-a26f-230692c3ed1a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.673060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd467-ae11-420b-a26f-230692c3ed1a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.673577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afd467-ae11-420b-a26f-230692c3ed1a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.675692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 296/568] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:27.681401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afd467-ae11-420b-a26f-230692c3ed1a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.687126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 273/569] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.688794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.689300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.689829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.705369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afd467-ae11-420b-a26f-230692c3ed1a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.710989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.711696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.712081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.712361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.712777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:27.713092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.713396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.714154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:27.715114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.725095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 274/570] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:27.725931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.738853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 297/571] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:27.741660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999636-9577-47d7-a8e3-834274a0c084 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.745464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.746462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.747350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.747623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.747896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.755891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.757933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.758140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341950ee-b13b-42af-8455-fabf3ec10dad admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.763521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.764318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.764775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.765194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.772869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:27.773489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.774551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 275/572] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.775480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.775813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.792145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:18:27.793163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfcc04-2415-4709-8354-05b61b05a488 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.795406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 298/573] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.796251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.807895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.808753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.809095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.809229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f824f-3ced-4248-aec2-d86755289dfd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.809403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.814001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.814652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.814938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.815215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.816048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.816358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.818278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.823880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:27.832798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 299/574] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.833603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:27.833788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.835566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 276/575] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.844206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.845750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82daf92-6f76-480a-b739-2b9e6aaa978b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.850781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.851504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.851844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.852221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.853072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.853390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.855129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70f422-c392-4244-8dfc-02afa81bdbe5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.855434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.859685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.860567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.860850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.861121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/8225ba8ede944425a2b21bb4eeb8ec10/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.875694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 300/576] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.876562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.878161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=8225ba8ede944425a2b21bb4eeb8ec10, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.880869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.887911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71468-eed7-49a3-a6af-1975d353fccd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.893855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.894900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.894900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.894900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.896096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:27.896096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.897836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.911336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 301/577] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:27.911336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.922407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd478bf-0b85-4f10-ad68-e03083b796ca admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:27.927173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:27.928161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:27.928455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:27.928734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:27.937078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 277/578] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:27 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/8225ba8ede944425a2b21bb4eeb8ec10/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:18:27.938669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.940058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:27.942111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:27.962700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:27.964312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 302/579] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:27.976587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:27.990557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a848-2ab7-49cb-bf1f-3d25799c27b4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.009907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d112-b31e-4420-99c9-1b273543da8e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.016385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.017442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.017864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.018242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.032413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.035523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.059505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.060257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.060643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.060903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:28.061108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.061930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.062336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.062734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 278/580] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:28.064428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.070076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.082368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 303/581] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:28.083229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbf85b-f9a2-458d-afd7-1952ec44f738 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.087915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.088697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.089595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.090051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.091058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.092020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.092475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.094264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.099905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eb2ee-60ac-4415-88f2-9c9ab9c1733e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.105168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.106389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.106581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.106957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.110776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 279/582] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:28.117103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.119175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.121017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.132062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b04c-5487-4808-97dd-d3ee869fde48 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.136672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.138019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.138305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.138584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.140534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:28.142744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 304/583] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:28.148273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.149027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.150565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.171070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:18:28.172709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 280/584] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:28.173498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53795d6-ea3c-40a6-838e-91aa01aafad4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.180786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.185575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.187184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.187704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.188176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.189344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.189898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.192055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4882-1cac-4d56-83e1-a962cff3bfed admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.192752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b588-8b4a-4cfc-b10f-d5f5b4ba6389 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.198234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.198916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.199200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.199510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.200964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.201274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.203797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59937f88-fecc-411f-8ffc-7462701400b8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.208732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 305/585] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:28.210362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cf23-8763-4300-af73-743d9f747315 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.210658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cf23-8763-4300-af73-743d9f747315 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.210939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401cf23-8763-4300-af73-743d9f747315 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.217564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 306/586] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:28.219730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401cf23-8763-4300-af73-743d9f747315 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.227014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 281/587] 10.222.0.65 () {56 vars in 1160 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:28.228760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.229067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.229349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.240119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401cf23-8763-4300-af73-743d9f747315 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.245789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.247467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.247767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.248049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/cac705ffe7884b0db365621e8bd286cc/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.255657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:28.256949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:28.267764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=cac705ffe7884b0db365621e8bd286cc, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.270452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.280335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 282/588] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:28.280335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.286720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0afb6-c707-4a83-a676-a15b5f7e8278 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.291693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.292635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.292976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.293311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.305363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.307474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.326056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:28.327517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 283/589] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:28.328689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.337739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8581-7501-42d9-ba7b-99254ee9e478 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.342363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.343165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.343482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.343804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.353902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:28.361086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:28.362681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 284/590] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:28.363467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.365663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 307/591] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:28 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/cac705ffe7884b0db365621e8bd286cc/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:18:28.372634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.389116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42cf04-7a2a-4076-a67d-8b332b6ecc9d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.495339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df0f95-1323-4bf4-921a-7ebeca9eda03 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.496366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.497511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.497965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.498386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.499338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.499574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.500022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.500373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.500758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.501133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.501999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.502410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.503082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.511326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.523873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 308/592] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:28.527390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 285/593] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:28.530141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.536188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.545521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c60f5-3062-49df-8501-8ed092e7b0d6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.547891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa710b3a-44b9-43c1-8e12-ac82ae846bdf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.552952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.553847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.554265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.554610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.557055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.557954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.558235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.558510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.565189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.567357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.577552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.584167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.588422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:28.589767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 286/594] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:28.597688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.613946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d60e-04c7-408d-b18b-d68ba492f5ce admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.615017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:28.616512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 309/595] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:28.619369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.619710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.620114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.620492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.621387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.621946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.622978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.624367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.633465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07b6e-91b7-443d-b64d-65c7d45a590c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.639353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 287/596] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:28.641255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.642055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.642426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.642806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.644399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.645066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.645841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.651643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.657878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886899ac-ba74-40ad-9e6e-2f928cd3e498 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.664122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.665198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 310/597] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:28.665399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.665690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.667591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/3db3df5c19dd4331a2c85d3a10bcb0f4/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.672400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.684298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed52be-e6f2-4b55-95e3-b40501a8f5d5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.685432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=3db3df5c19dd4331a2c85d3a10bcb0f4, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.688757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.695882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.697219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.697219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.697532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.706731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.709212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.726586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:28.731340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 311/598] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:28.733823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.746539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 288/599] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:28 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/3db3df5c19dd4331a2c85d3a10bcb0f4/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:18:28.753355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d61e63-ca33-4fc7-836c-0f6e493e392d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.836345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.837302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.837739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.838082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.839001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:28.839449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.842194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.868589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 312/600] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:28.873926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.884224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4c96-51ee-49b8-be3c-3b7159763ee8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.892392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.893095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.893381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.893657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.904231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.906036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:28.921246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 289/601] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:28.926535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:28.941017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37d0a-ce25-4cce-af09-26acf66a9ce0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:28.951982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:28.952906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:28.953193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:28.953521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:28.971540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:28.973508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:29.002342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:29.003814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 313/602] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:29.009666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:29.029960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0825db2-1e5a-414d-b7b8-cc1def2059cd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:29.036379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:29.037054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:29.037338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:29.037616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:29.038411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:29.038722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:29.040893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:29.060986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 290/603] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:29.066056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:29.076985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c772581-359c-4a1c-837e-447781d67b90 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:29.082167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:29.083003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:29.083234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:29.083537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:29.092755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:29.094631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:29.108358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:29.109838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 314/604] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:29.115029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:29.127151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247eba6-b165-454d-9aa1-4a57b6716448 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:29.132681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:29.133346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:29.133629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:29.133912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:29.134710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:29.135018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:29.136914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06329ac5-d020-4291-94e1-98d81545e7e0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:29.149849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 291/605] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:29.155912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:29.167712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557c80-ccc0-4c8c-8197-c013d83afb96 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:29.173270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:29.174195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:29.174751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:29.175210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:29.176304 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=5eccc516e4354bd78f33c775d7f2ac58) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:29.176793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:29.178902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3d060-868e-4084-adb9-5b2612449b00 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:29.185372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 315/606] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:29 2022] GET /identity/v3/role_assignments?user.id=5eccc516e4354bd78f33c775d7f2ac58&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:30.383602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f72b2-e126-4ed0-b09e-122414966cf4 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.384643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f72b2-e126-4ed0-b09e-122414966cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.385139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f72b2-e126-4ed0-b09e-122414966cf4 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.387575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 292/607] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:30.395935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.396435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.396512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.418133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:30.419884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:30.433042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 316/608] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:30.480003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f72b2-e126-4ed0-b09e-122414966cf4 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.497164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f72b2-e126-4ed0-b09e-122414966cf4 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.507146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.507992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.508279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.508555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.520591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:30.527670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:30.529776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 293/609] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:30.535442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.547700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511c16-a649-443c-9d30-820c0c282829 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.555544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.556219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.556503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.556782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.557532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:30.557836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.559513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.579549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 317/610] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:30.584680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.601487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d63b48-1e08-48a0-b24d-a8c1777c2d4c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.609081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.609870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.610160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.610620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.626907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.628886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.649243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:30.650740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 294/611] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:30.660646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.673556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c0505-bb30-4ba3-81e5-b5e200334ca3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.684164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.685336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.685622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.685899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.686618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:30.686927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.688554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.712707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 318/612] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:30.717913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.732671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73265db-955f-4c20-bdea-2a16b4d231d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.747947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.748801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.749096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.749377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.760432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.763042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.782615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:30.784007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 295/613] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:30.789509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.808222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419c968-f9d1-4d39-ad23-ecf5d2f2000c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.815402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.816067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.816350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.816629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.817462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:30.817769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.819641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.853281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 319/614] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:30.858884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.876733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e51e-aad3-42bb-b38e-98c79e3d9878 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.890254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.890254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.890254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.890254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.903008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.905020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4158a-b08c-4927-bd2a-0730a6f0a2ad admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.914396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 296/615] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:30.920143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:30.937603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664a497-6d9b-4f6c-b1f6-58e9d14374c5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:30.947432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa017-c619-4bf4-8ea9-3cfa653eee05 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.947731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa017-c619-4bf4-8ea9-3cfa653eee05 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.948011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231aa017-c619-4bf4-8ea9-3cfa653eee05 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.950210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 297/616] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:30.950849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:30.951767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.952056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.952341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.955728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:30.956029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:30.956309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:30.972813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:30.974672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:30.982620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:30.983838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:31.001020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:31.002390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 320/617] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:31.007742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.018401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb61451-3870-49b9-9cfb-99347dc717a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.021877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 298/618] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:31.023276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.024050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.024334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.024614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.025394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.025703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.027443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.039972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 321/619] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:31.045858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.055499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b11bf-2750-4ece-9662-de7e10f1d963 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.060681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.061529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.061811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.062085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.068655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.080610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fefd0-0788-4b0d-86a4-e145ac9f26ca admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.082539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.087267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.091081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.092064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.092243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.092533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.115192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:31.119491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:31.127869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 299/620] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.131878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:31.133350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 322/621] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:31.136967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.138916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.153851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843083c-4b98-42bd-bbd4-cb43c78169f8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.160748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9286b-6c08-45bc-bb80-8a0815a0a44d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.162425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.163176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.166501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.166501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.166501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.166501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.170386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.171699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.172354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.172637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.172971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.173715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.174022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.175807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.185659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 323/622] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.193202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 300/623] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.193867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.199945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.208589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4aa0-3ba0-4a63-a2e5-b483fa82910a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.217894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.219167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.219416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429669-a9ee-41af-8327-3613544ef4c8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.219921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.220383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.231986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.234002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.235406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.235700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.236543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.239142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.242710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.249185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.252040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.255081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 301/624] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.280993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:31.282598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 324/625] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.288443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.301390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709923f1-8d52-4382-b715-f1fa6a50d33f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.307522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.308268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.308558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.308837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.309702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.310015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.311912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.330886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 302/626] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.336549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.350221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5fa2-0d4e-432e-92ec-3a5130299316 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.356626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.357493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.357780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.358060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.370328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.372435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.389071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:18:31.390578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 325/627] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.396453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.414981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7caff-4edc-4346-81ea-1ca52c6f7316 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.421849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.422929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.423456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.423893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.425224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.425598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.427903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.453607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 303/628] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.458765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.469655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf4dd7-9029-4306-97b0-60e64a4f76ec admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.479920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.480587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.480929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.482169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.493431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.495212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a1c7d-c117-493b-ac9f-a0e44ea2b391 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.506889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 326/629] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:31.512364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.526186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c015f9-7d33-4e92-b5ae-938036293cf4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.532513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.533362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.533652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.533982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.551380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.553305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.577240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d41e4-4787-43f2-854c-e619d41376b3 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.577240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d41e4-4787-43f2-854c-e619d41376b3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.577384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d41e4-4787-43f2-854c-e619d41376b3 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.579334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 327/630] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:31.580333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d4b08221-3c0c-4d12-9ed1-12fee39782fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:31.581774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 304/631] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.587103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d41e4-4787-43f2-854c-e619d41376b3 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.589074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.589369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.589708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.605893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d41e4-4787-43f2-854c-e619d41376b3 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.616143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.616815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.617146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.617422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.618196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.618510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.619636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:31.620894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.621260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:31.630444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 305/632] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:31.638401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 328/633] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.644218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.655525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6d9ae-40e5-439b-bbc7-060d203ac779 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.658608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.660340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.661204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.661482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.661751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.670315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe247f5-3649-4c05-b846-cdc74e111366 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.670984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.673172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.676671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.677701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.678201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.678671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.688597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:31.690099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:31.690379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 306/634] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:31.695740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.698275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:31.700666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 329/635] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.706357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.707117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059205d-d38a-4048-996a-c57843ac4856 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.711906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.712561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.712842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.713113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.713968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.714292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.717575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245bc4-a292-4ad1-9e38-9d7df9443634 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.722250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545692e-ca8d-4bb5-b3d9-d126324f6e70 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.731075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.732001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.732459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.732883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.733234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 307/636] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:31.733939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.734393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.734543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a9a9-f908-4476-ac7c-fdb6edcc356f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.734836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a9a9-f908-4476-ac7c-fdb6edcc356f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.735107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a9a9-f908-4476-ac7c-fdb6edcc356f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.736614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5c7ed-45fe-4e8e-bdaf-22c2b91350e0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.740903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 308/637] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:31.742594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a9a9-f908-4476-ac7c-fdb6edcc356f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.749803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 330/638] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:31.755245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.755579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.755863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.763642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a9a9-f908-4476-ac7c-fdb6edcc356f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.773725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.774635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.775754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.775868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.776725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=8225ba8ede944425a2b21bb4eeb8ec10) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.777040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.780081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.780196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:31.781217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:31.786249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 309/639] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/role_assignments?user.id=8225ba8ede944425a2b21bb4eeb8ec10&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.786974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.795557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 331/640] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:31.807152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e394a1-0ef7-4199-960a-e0fdb52b1945 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.820104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.821010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.821343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.821604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.821718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.832115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45c78-4f7a-4dd2-9869-87cd2755f2c6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.838428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.838743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.839805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.840489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.841289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.841736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.860602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:31.863338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:31.865085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 310/641] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:31.868533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:31.870240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 332/642] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:31.875062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.876284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.886396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a7fc3-7d05-45f0-af22-16cdaad7c755 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.893839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361fd3c-75e6-4e6b-8299-79163752ed5c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.894357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.895273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.895746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.896175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.897092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.897581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.899419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.909989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 333/643] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.911409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.911628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.911877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.912153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.912884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:31.913189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.914897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.915512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.926432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be3aec-a321-4a45-af5d-d9c38f35b9fb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.931644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.933640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.934725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.935833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:31.942757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 311/644] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:31.952686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.954847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:31.957266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:31.977941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:31.979936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 334/645] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:31.982439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa354a-2aef-4ead-9d1a-fc19eba0a223 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:31.987085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:31.988268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:31.988407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:31.989022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:31.989565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.004084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.006461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.007158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347f50d-6556-488d-b5d7-4538d2dc9832 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.021475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.022148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.022430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.022706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.023457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.023771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.025375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.028620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:18:32.030498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 312/646] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.036495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.042067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 335/647] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.047815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bc97-e760-4f5c-ba68-ab9fe4fbec95 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.048232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.052911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.054019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.055110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.055674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.057108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.057614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.058515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f2fc-bacf-489f-b6f6-ad48dcba4728 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.060448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44515565-fff6-42d4-bee0-2bbe6e7c3fb0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.065828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.067164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.067488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.067762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.078585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.080796 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.081417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 313/648] 10.222.0.65 () {56 vars in 1158 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:32.084247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b53b-0e68-46ee-8e4e-99cc11386225 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.085125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b53b-0e68-46ee-8e4e-99cc11386225 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.085996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b53b-0e68-46ee-8e4e-99cc11386225 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.088464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 314/649] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:32.089479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b53b-0e68-46ee-8e4e-99cc11386225 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.097568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b6154b47-e5bc-4f0e-a8f9-dbb63a998d60 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:18:32.099694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 336/650] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:32.101236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.101515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.101791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.105225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b53b-0e68-46ee-8e4e-99cc11386225 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.113481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.114452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.114936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.115455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.123481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:32.124828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.124951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:32.126942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.133754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 337/651] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:32.134777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.139492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 315/652] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:32.148344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0d7fb-68d9-4c37-8de7-2a7d7e17df6f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.154031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.154531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.155553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.156041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.156582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.157829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.158899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.161286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.162192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416d20-7655-4c6d-bf9e-9f3d1e756607 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.168582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.169402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.169708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.169974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.181786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 338/653] 10.222.0.65 () {56 vars in 1160 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.181958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.182040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.185551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.195067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa880-6053-4d56-84a7-7239e07a5d8f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.200552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.201341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.201672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.201994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.203435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:32.205274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 316/654] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.206084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.214018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:32.216892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7cb70-470b-463a-9964-b55b25717c2c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.221983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.222269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:32.222625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.222910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.223187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.223847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 339/655] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.224761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.232191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.235164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.239876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec4aec-b3f8-4831-bed4-8d12184dcd29 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.245079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.245740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 317/656] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:32.246100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.246549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.247379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.247855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.249178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.249722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.251931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.257147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81a720-28ec-4f34-aac8-b6cc73c0b1fd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.263196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.264172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.264461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.264743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.265491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.265796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.266505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 340/657] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.267045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.267692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.276775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ae6d9-9d1d-4e7b-95cf-fe50d849a5c0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.277431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 318/658] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.278265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.289317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.290157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.290440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.290715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.292260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d422f6-faea-4908-98b2-7e2764ff3bc5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.297657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.298868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.299170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.299485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.302490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.304575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.308847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.311397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.323835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:32.326031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 341/659] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.326547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:32.326830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.328035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 319/660] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.330828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.336542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9373a6e-c55e-4fdf-a14d-153f4d1800e5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.341901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.342362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac611f3-c365-431e-99c0-c4f42af0b62c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.343250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.343626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.343905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.347963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.348699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.349087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.349486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.350308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.350716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.352459 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.357546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.359691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.366746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 320/661] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.368203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.378947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:32.379125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc71c02-2d70-40cf-bccb-0f5ee3ee381b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.380347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 342/662] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.383677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.388806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.389452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.389736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.390011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.391264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.391619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.394321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.395881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30fe6-111b-4ef3-87c4-05152ac49380 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.400584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.401389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.401670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.401998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.407492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 321/663] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.408311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.409716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.411930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.419562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a0be-71c4-4534-84f6-793b67daa286 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.424260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.424928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.425210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.425492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.426274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.426614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.427403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:32.428296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.428648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 343/664] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.429463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.440857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412c3f8-c3e5-4c96-85af-1b734fa90f33 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.442649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 322/665] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.443507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.450596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.451381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.451734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.452012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.452900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=cac705ffe7884b0db365621e8bd286cc) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.453270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.455639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.456842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81407892-02ca-4d48-b4ed-251dac1cb72c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.462307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.462971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.463259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.463601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.463785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 344/666] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/role_assignments?user.id=cac705ffe7884b0db365621e8bd286cc&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.464362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.464675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.464849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.468400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.485976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd218d-3d3f-4ce0-8ccc-675890ff6892 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.487011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 323/667] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.490863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.491818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.492100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.492518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.497432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.502266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.509913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.515330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958b3d8-58d7-4bb1-b2bc-b54772c818ec admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.526639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.527328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.531363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.531363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.531363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=3db3df5c19dd4331a2c85d3a10bcb0f4) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.531363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.531363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.537036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:32.545881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 345/668] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.546853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.547509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 324/669] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/role_assignments?user.id=3db3df5c19dd4331a2c85d3a10bcb0f4&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.565942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0142d2-45a9-487a-8af9-2c3d731f46f7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.578932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.578932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.578932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.578932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.579713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.579713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.581741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.609111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 346/670] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.614608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.625401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ffe8-496f-4460-94f4-c2c6e3d5ff20 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.640236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.641341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.641685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.642015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.656493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.658555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.679014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:32.680747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 325/671] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.687499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.698201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fefa9-3599-48e6-9311-f16b963af3d8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.703266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.704053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.704342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.704620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.705567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.705877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.707631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.727182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 347/672] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.733343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.744477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383ce7-8aac-40f4-8d5f-b52f1aa4c625 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.749408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.750188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.750516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.750790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.758265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.760342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.773856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:32.775442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 326/673] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:32.781605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.792494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5f09-9544-42f0-b68b-3ebdb6b8c1c0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.797976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.798736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.799020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.799370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.800158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:32.803646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.805595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efac6-6a8d-45b5-8f43-852148e6b338 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.819154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 348/674] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:32.825302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:32.841716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bc740-7cd1-43f7-b118-7d0c95890825 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:32.849403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:32.850302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:32.850583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:32.850855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/5eccc516e4354bd78f33c775d7f2ac58/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:32.869429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=5eccc516e4354bd78f33c775d7f2ac58, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:32.872144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee0c8a-9758-4752-b409-551a6949a13a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:32.948462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 327/675] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:32 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/5eccc516e4354bd78f33c775d7f2ac58/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:34.439399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8a94-fca5-4f75-ad5f-ad78def731f4 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.440422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8a94-fca5-4f75-ad5f-ad78def731f4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.440922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e8a94-fca5-4f75-ad5f-ad78def731f4 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.443317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 349/676] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:34.448938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.449817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.450928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.475979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:34.477463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:34.550302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 328/677] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:34.574473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8a94-fca5-4f75-ad5f-ad78def731f4 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.588158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e8a94-fca5-4f75-ad5f-ad78def731f4 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.592461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.593239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.593516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.593787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.613200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:34.620004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:34.621204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 350/678] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:34.627382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.636448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431932-6a60-4a21-a0f3-8d3b405ebf46 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.644388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.645059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.645338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.645610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.646498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:34.646804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.648415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.657767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 329/679] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:34.663074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.673212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062fe9-88ce-4bc6-9458-184bca807571 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.677656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.678457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.678753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.679008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.692096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.693863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.710992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:34.712504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 351/680] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:34.717920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.727812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e3e-5a83-4dc2-997f-ac979c0ff126 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.732814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.733470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.733749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.734022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.734741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:34.735041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.736664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.750426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 330/681] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:34.755901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.766137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90471138-00c3-4392-84de-e91e0b9e6027 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.770665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.771476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.771756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.772029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.780308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.782320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.796328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:34.797848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 352/682] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:34.803386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.813932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecee15d-78c0-4029-8ccd-88f8b2f5dbf6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.818314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.818974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.819250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.819555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.820385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:34.820689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.822519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.840357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 331/683] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:34.845389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.857507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c33f3-d303-42bc-a6fb-e7abee71650b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.876010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.876686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.876972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.877256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.885865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.888241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b8664-ddfc-4c4a-949b-5fbde35d78e8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.906743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 353/684] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:34.912061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.921834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2edad-ac1d-4a9d-91b6-5115aa7e0488 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.930921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:34.931738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.932017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.932286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.943907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:34.945690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:34.947859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045919bf-4bc5-4d24-9f01-20ca09e8bbc5 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.948154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045919bf-4bc5-4d24-9f01-20ca09e8bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.948435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045919bf-4bc5-4d24-9f01-20ca09e8bbc5 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.951046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 354/685] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:34.956149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:34.956441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:34.956717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:34.964202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:34.965867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 332/686] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:34.972103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:34.992668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e8941-50c1-4d13-aa69-d74a162c87e0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:34.998237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:34.999486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:35.005961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.006635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.006915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.007189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.007960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.008269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.009893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.019121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 355/687] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:35.042583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 333/688] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:35.048278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.050596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.058880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa447f7d-56a8-4922-b012-484824f3e541 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.064654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712ec1-57f8-4387-9782-d0a5b30d2866 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.072524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.073633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.074254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.075351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.081071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.081908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.082197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.082477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.083153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.084249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:35.084249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:35.084249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:35.085152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.086206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.088696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.103937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:35.105124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:18:35.106293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 356/689] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:35.106559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 334/690] 10.222.0.65 () {56 vars in 1150 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:35.115885 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.116062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.127006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5f50d-a55d-4975-8adb-7376399bd279 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.127441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba3f0c-f280-4230-ab47-758090afebfd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.142683 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.143739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.145173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.145663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.146247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.146882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.147246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.147843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.159829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.159829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.160015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.160015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.160138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:35.160138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:35.160138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:35.160138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.160359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.165577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 357/691] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:35.171011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.176728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 335/692] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:35.181693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e5ef-2edb-473b-86b4-663a1297ebf5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.182975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.193880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.195597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.196034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.196320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.199011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ff6b5-9e50-4aba-8c5a-76a7e7d000a4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.200378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.200745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.203201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79205c83-b8c3-4592-808f-f1463372fea8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.208957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.209883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.210171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.210453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.212860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.218202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.218307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 358/693] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:35.218382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08c316-45ba-4ee6-b87a-0dbb11f318ad admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.224235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 336/694] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:35.406998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575d34-eb55-4f98-9036-cac75c75df18 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.407527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575d34-eb55-4f98-9036-cac75c75df18 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.407937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575d34-eb55-4f98-9036-cac75c75df18 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.410327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 359/695] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:35.416284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a639f-a853-4ef2-a543-034e12ccf6a0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.416810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a639f-a853-4ef2-a543-034e12ccf6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.417205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a639f-a853-4ef2-a543-034e12ccf6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.441095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b83a639f-a853-4ef2-a543-034e12ccf6a0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:35.443497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b83a639f-a853-4ef2-a543-034e12ccf6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:35.458393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 337/696] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:35.484076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575d34-eb55-4f98-9036-cac75c75df18 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.500812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575d34-eb55-4f98-9036-cac75c75df18 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.511719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.513012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.513553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.514133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.529019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.530004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.539678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185966-66d1-4757-b97a-85b11eefc1aa None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.539871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185966-66d1-4757-b97a-85b11eefc1aa None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.540129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9185966-66d1-4757-b97a-85b11eefc1aa None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.541927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 338/697] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:35.549062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.549354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.549636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.554711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:35.556272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 360/698] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:35.562220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.572543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33edc-a2c3-4378-815f-4ba5675b42bd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.580497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:35.581683 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:35.582707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.583800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.584410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.585012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.586298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.586840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.589039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.595342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 339/699] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 21 09:18:35.609189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 361/700] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:35.615118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.617462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.628523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b68-f7f6-4f27-b71b-b5501f7dcf70 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.630113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007b20d-d157-4bb2-a6d6-2e8cc786b8a9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.635396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.635396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.635396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.635396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.635765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.637036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:35.637036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:35.637036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:35.637593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.642528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.643539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.644925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.645449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.646400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.648688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1b021-9ae0-40a0-bd60-19d731fce7ce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.651651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:18:35.660322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 362/701] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:35.660322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.674030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94744-caef-4647-8fdc-7a5bb421b5d1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.678856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.679590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.679875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.680150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.680882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.681187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.682870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.688863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 363/702] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:35.694655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:35.705494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126a3c-cfd8-4935-9cca-3c001b753534 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:35.710172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:35.710782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:35.711068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:35.711476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:35.712079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] RBAC: Adding query filter params (type=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:35.712389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:35.713989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a37e0a-2855-48ad-99ca-89741609e70a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:35.719714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 364/703] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:35.762477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 340/704] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:18:35 2022] POST /identity/v3/users => generated 254 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:36.052778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396499c-ae51-4903-a985-08c676fbdf78 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.053147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396499c-ae51-4903-a985-08c676fbdf78 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.053319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396499c-ae51-4903-a985-08c676fbdf78 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.055253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 365/705] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:36.060643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.060937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.061218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.087243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:36.088453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:36.101627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 341/706] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:18:36.125362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396499c-ae51-4903-a985-08c676fbdf78 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.139339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396499c-ae51-4903-a985-08c676fbdf78 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.144635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.145425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.145711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.145988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.159195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:36.167454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:36.171662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 366/707] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:36.174400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.184188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaee634-baf9-4d4f-9f8f-87ec68e77dcb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.189892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.190564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.190850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.191130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.191910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.192221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.193832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.204203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 342/708] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:36.209706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.220398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bf4b-381d-41b1-b7d2-3ed9b033cf74 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.225136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.226030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.226361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.228702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.238690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.240627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.258600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:36.260184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 367/709] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:36.266537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.276509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb167-e086-4150-b3aa-b56320b9aa68 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.282068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.282793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.283084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.283390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.284183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.284492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.286157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.303588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 343/710] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:36.312562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.326110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b7a1-261f-4308-8776-356843829dbb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.330597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.331415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.331705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.331987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.349588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.351659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.370552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:36.372670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 368/711] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:36.378099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.395324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12889e75-907b-4895-8541-6fd069ea7dc5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.407925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.408764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.409187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.409624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.410610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.411058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.413085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.437552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 344/712] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:36.443217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.453093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8773b2-2d76-42c5-a509-071a4c358eb2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.463410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.464217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.464640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.465075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.478633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.480563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.492411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 369/713] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:18:36.498420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.509328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b851d8-84fc-4bdb-864e-4f52b7e2e96c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.519627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.520585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.521029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.521456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.538132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.540204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.564954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:36.566438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 345/714] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:36.571776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.586747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ef38a-6e70-41a6-b9ea-9841d2f7516d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.600564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.601458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.601935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.602420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.603359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.603858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.605716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.628722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 370/715] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:36.634427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.648290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b92c-3a70-4321-8d11-99456690b6d8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.655351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.656201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.656487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.656814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.669481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.671538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.686409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:36.687916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 346/716] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:36.693117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.707363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73750e62-3c45-41a1-b37e-3fa9fc5eaf22 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.720195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.720895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.721177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.721447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.722247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.722550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.724428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6599d21-65f6-4f01-b666-7d75968135e8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.740297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 371/717] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:36.746185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:36.760281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81357a4c-5c9e-402b-a104-5b2c60fcbf08 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:36.767907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:36.768602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:36.768888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:36.769159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:36.770042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=5eccc516e4354bd78f33c775d7f2ac58) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:36.770354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:36.772340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a7e8d-3de0-4cbd-8247-0f517951942b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:36.784241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 347/718] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:36 2022] GET /identity/v3/role_assignments?user.id=5eccc516e4354bd78f33c775d7f2ac58&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:38.067279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94cdab-7557-44f0-8200-f97bc94aa8ee None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.068185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94cdab-7557-44f0-8200-f97bc94aa8ee None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.068185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94cdab-7557-44f0-8200-f97bc94aa8ee None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.069862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 372/719] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:38.076779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6b44-cc60-4b40-bdf5-a3aab4b3ee65 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.076779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6b44-cc60-4b40-bdf5-a3aab4b3ee65 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.076779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6b44-cc60-4b40-bdf5-a3aab4b3ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.104332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-90df6b44-cc60-4b40-bdf5-a3aab4b3ee65 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:38.105929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-90df6b44-cc60-4b40-bdf5-a3aab4b3ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:38.114593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 348/720] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:38.149892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94cdab-7557-44f0-8200-f97bc94aa8ee None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.172863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94cdab-7557-44f0-8200-f97bc94aa8ee None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.177266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.177919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.178197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.178469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.179183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.180218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:38.180218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:38.180218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:38.181092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.236622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3684f-15c6-4249-8f26-5f9949a30f10 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.236999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3684f-15c6-4249-8f26-5f9949a30f10 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.237225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3684f-15c6-4249-8f26-5f9949a30f10 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.238985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 349/721] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:38.244031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.244315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.244589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.262916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:38.264133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:38.272675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 350/722] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:18:38.298420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 373/723] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:38.307936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.317532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070006a7-3772-4d0d-a924-032586cc4f8a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.334437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.335256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.335578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.335855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.350338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:38.357488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-93921269-f885-4afb-8968-c1a2b3dde494 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:38.359022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 351/724] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:38.364939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.375993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15158-1dec-4988-a456-d6255a7c61ed admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.380634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.381309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.381591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.381871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.382708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:38.383019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.384802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.386426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523df6a-a037-4358-b99c-e36f80b31cb5 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.386714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523df6a-a037-4358-b99c-e36f80b31cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.386994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523df6a-a037-4358-b99c-e36f80b31cb5 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.389857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 352/725] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:38.401259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.401802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.402238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.406852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 374/726] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:38.413669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.424267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995df2f-b47a-4814-ba1d-e8f834a77863 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.435358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.435358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.435358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.435358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.444531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:38.445057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.446229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:38.447274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.468721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:38.470498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 375/728] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:38.470703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 353/728] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:38.476322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.487001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81370d-920c-47ff-80f1-bcf928a85398 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.492132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.492961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.493367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.493798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.494692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:38.495124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.497032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.510456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 376/729] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:38.513155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.517645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.528613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20056-458e-40cc-8b92-c95479b99614 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.534302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.535470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.535857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.536279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.537562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b155d9-9f9b-480a-a8f3-05afd1745bcf None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.545946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.548263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.550865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.552665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.554430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.556294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.557179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.560162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:38.560162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:38.560162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:38.561498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.577474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:38.579188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 377/730] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:38.585266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.596851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012e32-9895-4114-b744-80b3d92faaa1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.601793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.602726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.603127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.603607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.604743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:38.605160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.607500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.629504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 378/731] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:38.634846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.646528 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9409d8-7adf-41f0-9c33-c056df9bf1bf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.654008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.654813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.655100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.655437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.658112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 354/732] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/services => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:38.670054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.672179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.693778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:38.695649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 379/733] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:38.701607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.723543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22618d-37e9-4017-a40c-b35464c71d01 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.728715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.729561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.729853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.730134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.730985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:38.731326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.733203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.748803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 355/734] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:38.754718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.765746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea5d-35b7-473e-b8ff-eaec3a00795f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.771061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.772018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.772305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.772637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.780713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.782785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.797407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:38.799039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 380/735] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:38.804447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.815564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64fc9-817f-45da-a323-ded38f9517a8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.823999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.825317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.825611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.825946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.826752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:38.827121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.829097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe66cca-bee9-4486-8346-e15af156a196 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.846955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 356/736] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:38.852981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.866537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6f7-b99d-4c22-b7d6-f5d787079d36 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.866847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6f7-b99d-4c22-b7d6-f5d787079d36 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.867097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6f7-b99d-4c22-b7d6-f5d787079d36 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.868266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0024926-6d51-4ba2-88e5-d927255c02dd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.870053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 357/737] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:38.875183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:38.876848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.877137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.877465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.879561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:38.879847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:38.882154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:38.885984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=e7eb5c189bbd41449e3478b7dfcb27fb, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:38.889628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:38.901789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:38.903076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:38.911633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 358/738] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:38 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:38.935870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:38.945238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747f4fa-1982-4c39-96a0-afbac84bc6a2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:38.956790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 381/739] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:38 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:39.024381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.025205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.025494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.025774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.043826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:39.050993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:39.052481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 359/740] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:39.058568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.072621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a01d3-c218-4e68-874b-cfadb542c6c4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.079197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.080232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.080780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.081259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.082257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.082777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.084745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.094448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 382/741] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:39.100469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.116761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c0c7-7fb2-4633-9fc3-4037d8ee117f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.127830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.128645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.128929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.129203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.152592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.155144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.176713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:39.178293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 360/742] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:39.183824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.197231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b0efe-54e9-4384-809b-8b6404d7724b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.203422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.204412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.204912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.205397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.206351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.206973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.208974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.224715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 383/743] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:39.230451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.244380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39643-49c2-4877-81e4-439ebbd704e4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.251502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.252625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.253217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.253712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.263394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.265745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.281214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:39.282962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 361/744] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:39.288800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.299269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a492-3a29-4805-a628-02b5e1ffb404 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.304172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.305168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.305685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.306206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.307289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.307830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.310124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.329414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 384/745] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:39.335122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.346330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365f68c-d363-4b99-b74d-9dae30490a11 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.351253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.356321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.356817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.357354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.366144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.368221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.381930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 362/746] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:39.388058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.398645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a3304-879a-491e-9dc6-d06e6879d7f1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.408272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.409419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.409924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.410460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.422022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.424212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.442268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:39.444254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 385/747] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:39.449336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.463551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37614-b112-423d-8d26-3977ea11673f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.468495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.469453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.469997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.470572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.471524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.472055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.473960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.491329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 363/748] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:39.497256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.520654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a7bb-4ec0-43ef-964d-2c0c4c89ffc5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.531074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.531899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.532186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.532466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.543377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.545379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.567001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:39.568565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 386/749] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:39.578411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.588895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e0a4-a7bf-4968-b22d-63a618355fd5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.593803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.594751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.595320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.595816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.596873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.597571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.599728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afdaab-0b92-439c-a855-c6679e7afc3c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.613635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 364/750] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:39.620372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:39.641365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e8cb8-bfb7-4610-851e-57d97058ba2e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:39.651929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:39.652607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:39.652924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:39.653198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:39.654045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=1914a3193cd74814b7344c15a1eb0beb) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:39.654358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:39.656300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f400f30-788a-4118-bf65-a56e13c7cc40 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:39.668429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 387/751] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:39 2022] GET /identity/v3/role_assignments?user.id=1914a3193cd74814b7344c15a1eb0beb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.062338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bacded-fd6c-4012-8788-deedf8328dab None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.062695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bacded-fd6c-4012-8788-deedf8328dab None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.062815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bacded-fd6c-4012-8788-deedf8328dab None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.065028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 365/752] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:40.070874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.071166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.071479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.099498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:40.100719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:40.114600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 388/753] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:40 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:40.139114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bacded-fd6c-4012-8788-deedf8328dab None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.156782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bacded-fd6c-4012-8788-deedf8328dab None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.165056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.165859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.166154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.166416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.181895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:40.189339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:40.195349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 366/754] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:40.197913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.212519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec757f-dd6a-4a85-bf53-7d511b193b9d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.220819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.221493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.221777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.222058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.222818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.223128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.224752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.238963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 389/755] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.244603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.256419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419ce6f-86ac-445f-802a-2eeabeacc2af admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.260910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.261680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.261961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.262791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.281158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.283010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.301121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:40.302452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 367/756] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:40.308048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.320923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3687a57-39c3-4c99-9f13-581b196148e7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.326127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.326793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.327079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.327387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.328120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.328432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.330070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.347469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 390/757] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.352318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.365302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bab391-0693-4037-a104-6c8148bbdb87 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.370505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.371321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.373271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.373271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.388805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.391197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.406528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:40.408269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 368/758] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:40.413725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.428314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109a3a-ea34-4354-9ad0-54c8115986a8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.435956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.436626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.436964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.437243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.438196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.438517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.440481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.469114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 391/759] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.474783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.484890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b477bea-44e1-480f-9863-8b9f524659cc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.495529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.497006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.497589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.498085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.516494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.518543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.528137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 369/760] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:40.533658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.549813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c208a6-59e2-4650-89db-ce7128e3f59f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.560433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.561304 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.561590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.561867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.581245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.581495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.603990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:40.605202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 392/761] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:40.611535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.624891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c78c7b-c58d-433a-af56-c33d97ddfe46 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.640502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.641742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.642343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.642832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.643807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.644326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.646161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.665130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 370/762] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.670988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.686620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661e9b-834f-4f95-8da5-4672f8b9c5d0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.693924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.694717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.695000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.695276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.712456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.714413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.731326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:40.732820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 393/763] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:40.738345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.755324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6c328-2b26-4fe9-b9dd-d3f196319288 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.760036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.760693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.760974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.761247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.762027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.762360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.764226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79375797-6432-409f-8fd5-73d827bcf65c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.776531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 371/764] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:40.782641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:40.793038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2ccd-41ee-4cc4-a882-0c81b69b0f94 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:40.798003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:40.798641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:40.798920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:40.799195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:40.800042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=5eccc516e4354bd78f33c775d7f2ac58) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:40.800350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:40.802189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1694ced-8cf1-49a1-aee2-670f7336db1c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:40.808067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 394/765] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:40 2022] GET /identity/v3/role_assignments?user.id=5eccc516e4354bd78f33c775d7f2ac58&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.424755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e716-f5ed-4eca-be64-e7ae97895112 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.425276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e716-f5ed-4eca-be64-e7ae97895112 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.425276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e716-f5ed-4eca-be64-e7ae97895112 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.427325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 372/766] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:41.432275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.432675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.432857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.455466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:41.456682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:41.467154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 395/767] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:41 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:41.501558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e716-f5ed-4eca-be64-e7ae97895112 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.519945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252e716-f5ed-4eca-be64-e7ae97895112 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.524504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.525299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.525587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.525865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.526523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.528731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.545666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-34f76b76-afc9-46b9-9eb6-ac5a8c6474a8 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:18:41.551225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 373/768] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:41.552583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.568361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e763d1-d42e-455c-a278-e09d6b2f7ff4 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.574455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10bd0-a870-48f1-a82c-d1807581572f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.574455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10bd0-a870-48f1-a82c-d1807581572f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.574455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10bd0-a870-48f1-a82c-d1807581572f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.576252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 374/769] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:41.580564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.581274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.581470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.581841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.582540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.582843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.583158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.583478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.583761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.584449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.592164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 396/770] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.601196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.618833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:41.620053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:41.622944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b238c9b-eea6-43a3-9f4d-e1c064a05114 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.630977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.631747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.632037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.632319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.633039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.633350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.634955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.635136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 375/771] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:41 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:41.646298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 397/772] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.651792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.664689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68333-b8d3-418a-9c81-1ad3e4e872f0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.665628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.669543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.670297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.670582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.670855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.671677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] RBAC: Adding query filter params (interface=public, service_id=1cac540c32c84c81984da90a13b15598, region_id=RegionOne) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.671986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.673006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:41.673006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:41.673006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:41.673885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.686761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2324d6-891b-4231-aa4b-ed9aad020b11 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.688108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 376/773] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/endpoints?service_id=1cac540c32c84c81984da90a13b15598&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.693535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.699128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.700607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.700887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.701157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.701863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.703649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.704926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d97b7f-6842-4f3f-9506-b073bf3ddc56 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.715403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.716291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.716752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.717208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.718089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.719276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:41.719276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:18:41.719276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:18:41.720476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.722072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:18:41.726389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 377/774] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.731789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 398/775] 10.222.0.65 () {56 vars in 1150 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:41.732820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.749228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040eff5-bf36-4505-b21c-40dba761c180 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.765167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.766444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.766915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.767405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.768299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.768797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.770591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.779574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 378/776] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:41.785453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.800606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9fa4-f4d7-4df2-921b-1cc81d06c6a1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.807723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.808475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.808755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.809613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.810327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.810689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.812454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.824482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 399/777] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.830291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.845179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11413139-1539-4951-ad80-564b6bceae97 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.850191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.851189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.851723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.852203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.853214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] RBAC: Adding query filter params (interface=public, service_id=89d6b781fee1409684dd2a50887279de, region_id=RegionOne) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:41.853752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.855615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29f007-c986-4c33-8174-dca2ff0c2d48 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.864478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 379/778] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/endpoints?service_id=89d6b781fee1409684dd2a50887279de&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:41.869641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:41.889379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3bbcf-46a2-462c-8efa-21b93f58caa3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:41.897199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:41.897882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:41.898171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:41.898452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:41.899146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:41.900791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b737d4-7bd7-49f0-88ce-c32d1b6479cb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:41.907559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 400/779] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:18:41 2022] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:42.119698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a04e-9432-446a-ba11-f2cb12ec191d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.119698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a04e-9432-446a-ba11-f2cb12ec191d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.119698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a04e-9432-446a-ba11-f2cb12ec191d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.121700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 380/780] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:42.127335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.127649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.127938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.150398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:42.151626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:42.167406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 401/781] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:42 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:42.186882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38a04e-9432-446a-ba11-f2cb12ec191d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.200193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38a04e-9432-446a-ba11-f2cb12ec191d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.207258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.208089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.208373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.208648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.221931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:42.232042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:42.233644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 381/782] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:42.239452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.251576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb391a-763f-46de-8e58-b271fe8cf0fa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.257476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.258336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.258790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.259221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.260185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.260651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.262946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.278690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 402/783] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:42.280293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.290425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7f973-e86a-416d-a324-d1185f40c5f0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.295346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.296301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.296756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.297189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.308130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.310344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.328912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:42.335428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 382/784] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:42.339662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.354719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fad67-aa49-43f2-a664-64e0e56ce028 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.362001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.362925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.363429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.363861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.364784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.365259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.367074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.387624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 403/785] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:42.389924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.400369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acae1d-bcff-4b37-8a9d-1bd8747600f0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.405754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.406710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.407175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.407624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.415480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.417669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.431743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:18:42.438587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 383/786] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:42.440069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.450931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92cbb6-685d-48a8-99f1-ca029f4902db admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.455983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.456909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.457400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.457844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.458870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.459418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.461453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.485120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 404/787] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:42.490972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.502482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116aca1-0751-4c9e-9f13-0367e4a09b26 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.507535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.508404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.508940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.509428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.524021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.526148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.540436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 384/788] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:42.546991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.558019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f086c3-92aa-4d99-bdd2-f6bb70717350 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.566592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.567666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.568121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.568624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.586084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.588104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.613285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:42.614497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 405/789] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:42.619998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.629121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3773cc-eec2-400d-aa45-4b3b056235c3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.640906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.641836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.642135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.642463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.643191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.643574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.645175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.663814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 385/790] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:42.669930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.684716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26cb1-da23-4100-a6da-e645983ad38b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.691456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.692359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.692643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.692914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.706152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.708132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.726680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:42.728191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 406/791] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:42.734412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.747949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb854-9ac5-416e-b370-45f5e80f18b9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.758321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.758989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.759273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.759588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.760380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.760694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.762589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e761d-d9f6-44ed-840c-0b2a1f60b5e8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.784535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 386/792] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:42.789951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:42.809665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44e7c-92df-4f00-98fd-2bddcdb5789e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:42.815974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:42.816623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:42.816900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:42.817171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:42.817995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:42.818306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:42.820158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd524f-014e-4eab-9332-a1e89f33a23c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:42.832073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 407/793] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:42 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.075650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f909-8645-4f90-9d7f-163a22e52e65 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.075985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f909-8645-4f90-9d7f-163a22e52e65 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.076164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f909-8645-4f90-9d7f-163a22e52e65 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.078129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 387/794] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:43.084703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.084991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.085268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.106753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:43.108060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:43.117724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 408/795] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:43 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:43.140583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2f909-8645-4f90-9d7f-163a22e52e65 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.154057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2f909-8645-4f90-9d7f-163a22e52e65 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.158651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.159472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.159743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.160012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.173859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:43.181194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:43.182787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 388/796] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:43.189280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.200450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554fe81-13cc-40af-a23b-5a8a1590d862 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.205107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.205832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.206111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.206437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.207186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.207527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.209176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.218239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 409/797] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.223747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.233629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35349e4-6381-49f3-b52c-8d9fd80d9cb4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.238210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.238985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.239331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.239644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.252925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.254927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.273869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:43.275568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 389/798] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:43.281302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.292353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d6ff-cbd9-4fdf-b0ea-65a7179a58fb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.296891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.297609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.297897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.298171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.298935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.299243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.300886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.314634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 410/799] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.320178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.331557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7f7a-f014-434e-b28c-0f2a98f16c2f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.336019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.336865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.337142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.337408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.346636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.348820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.363553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:43.365170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 390/800] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:43.370745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.381370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edf1e-9bc5-418a-a961-72676b41428e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.385994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.386706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.387013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.387978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.388820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.389226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.391452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.412345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 411/801] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.417794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.428186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a18df3-b079-43dc-95a9-1839c1ba4be0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.432883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.433704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.434571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.434849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.446338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.448292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.466036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:43.467558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 391/802] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:43.473057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.483377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc2c9e-6ca7-4535-a2c4-b8c2b554fddb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.488096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.488801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.489079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.489402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.490180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.490483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.492225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.507633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 412/803] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:43.516600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.531353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa2ba2-0454-4b32-bd2f-c33862ef1d84 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.537903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.538747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.539025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.539332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.552467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.554500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.578274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:43.578274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 392/804] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:43.581096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.593546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942183d-2f0f-4d0e-b179-8ae6fe39132c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.600999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.601661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.601994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.602265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.603050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.603448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.605401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e16a-4267-40f4-8b19-d017575e6dcc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.622775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 413/805] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.628684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.644523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebba90-e265-4361-a1e3-8dfb71730519 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.651327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.651327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.651327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.651864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/1914a3193cd74814b7344c15a1eb0beb/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.674297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=1914a3193cd74814b7344c15a1eb0beb, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.677412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.735386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f66ee-7ccb-45df-9092-4508230447cf None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.736029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f66ee-7ccb-45df-9092-4508230447cf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.736525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f66ee-7ccb-45df-9092-4508230447cf None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.738843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 414/806] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:43.743817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.744353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.744822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.772532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:43.774235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:43.785916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 415/807] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:43 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:43.811508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.821225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92b66f-e104-473a-9078-1212614aae1b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.822512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 393/808] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:43 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/1914a3193cd74814b7344c15a1eb0beb/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:43.882688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.883498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.883785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.884061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.896119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:43.903288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:43.909507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 416/809] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:43.910959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.922017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d403274-145d-4ac6-9c01-03ec82a12ead admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.926717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.927482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.927769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.928047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.928853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:43.929159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.930828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.945744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 394/810] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:43.947241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:43.958429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752eebe-5eeb-4b49-a781-6fec2dd5eda5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:43.963401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:43.964268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:43.964609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:43.964890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:43.978637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:43.980519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:43.999130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:44.005101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 417/811] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:44.006511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.017061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823af3a7-3c4e-41ae-828c-d002dd281b27 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.021856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.022580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.022879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.023158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.023974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.024283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.025944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.039392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 395/812] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.045347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.055921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ccb94-0401-4821-8d84-be117ca8d57d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.060731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.061579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.061916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.062193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.071512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.073633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.088521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:44.094950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 418/813] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:44.096372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.107331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec5e13-fe52-42be-a706-8415b98fa5d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.112055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.112785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.113131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.113412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.114311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.114621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.116586 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.143151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 396/814] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.148899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.159834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11d5a3-bb63-48b3-9130-bccaad0ec0ce admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.164630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.165516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.165803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.167611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.188104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.189965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.210819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:44.212443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 419/815] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:44.221353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.235912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa992-93c4-4c08-a05f-af59279bb410 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.242638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.243645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.244184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.244692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.245667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.246175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.248616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.266208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 397/816] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.271453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.282372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b826f9-e97a-4a2f-b8c1-5d258054afb4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.291936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.292736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.293022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.293342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.306546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.308565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.329896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3bf2ab4a-9973-4d80-baa7-cb01521ba735 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:44.339795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 420/817] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:44.345501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.350559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b0fa-0ba8-42e6-bf67-b7b5fc180e3d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.350856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b0fa-0ba8-42e6-bf67-b7b5fc180e3d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.351143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b0fa-0ba8-42e6-bf67-b7b5fc180e3d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.353228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 421/818] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:44.359247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.359563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.359843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.360247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e9a7-6f73-40b9-963e-000298d2c4fa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.371257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.372506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.372793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.373073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.373865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.374178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.376079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.394058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 398/819] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.395770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:44.397861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:44.409921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.414242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 422/820] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:44 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:44.421237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e772a-909c-4be6-a943-642de25c3a87 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.437873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.438487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.439745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.440235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.440725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/5eccc516e4354bd78f33c775d7f2ac58/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.447694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787b96f-bcf8-4f8b-a3fe-b229e9de2ca8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.448986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=5eccc516e4354bd78f33c775d7f2ac58, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.452044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0234a6-24f8-4973-99bc-23b21fe9661f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.458815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.459916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.460407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.460880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.461806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.463643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.475537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:18:44.477721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 423/821] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:44.483909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.493897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282e1b-b389-4fa0-b893-aeabad21430e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.499103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.499911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.500254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.500534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.501300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] RBAC: Adding query filter params (name=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.501613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.503279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.508805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 424/822] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.514476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.524753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a5fa-74ec-4454-8b16-c4897ac0d6cf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.529442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.530110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.530397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.530680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.533340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:44.533340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.533497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.541574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 399/824] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:44 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/5eccc516e4354bd78f33c775d7f2ac58/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:44.541832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 425/824] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:44.558542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:44.569291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1515a-0099-4bb2-a3da-9b1ca624f34d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:44.659721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:44.660316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:44.660606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:44.660888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:44.661640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:44.662672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:44.662672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:44.662672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:44.663597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1bcb6-3d64-46da-869a-38a8f85f3a13 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:44.817396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 426/825] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:18:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:45.010299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a061-f5d6-4fa4-b956-5147a58c4297 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.010600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a061-f5d6-4fa4-b956-5147a58c4297 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.010841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43a061-f5d6-4fa4-b956-5147a58c4297 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.013070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 400/826] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:45.019649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.019947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.020231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.042474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:45.044344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:45.070595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 427/827] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:45 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:45.106676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a061-f5d6-4fa4-b956-5147a58c4297 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.122365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43a061-f5d6-4fa4-b956-5147a58c4297 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.128610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.129408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.129687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.129956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.130613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:45.132220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:45.147449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:18:45.148848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 401/828] 10.222.0.65 () {56 vars in 1150 bytes} [Mon Feb 21 09:18:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:45.156008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.165779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734dbc5-85fe-4688-9bf8-5ef56418f583 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.170718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.174536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.175050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.175587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.176534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:45.177062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:45.178990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:45.185476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 428/829] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:45.191591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.210068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28001a1a-0187-4eef-ba5a-a0ab7d74941f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.214989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.216617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.216967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.217250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.218020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:45.218334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:45.220037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1c87-c203-44dd-b5e7-cf8cd359d1fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:45.228579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 402/830] 10.222.0.65 () {56 vars in 1145 bytes} [Mon Feb 21 09:18:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:45.234027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.244576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7089a-9e4f-4594-970a-a095f97c2a27 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.251882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.252548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.252887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.253267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.254020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:45.255719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235b0ab-5478-45eb-8d08-ff6ac1d9ff44 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:45.341533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 429/831] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:18:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:45.873235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da8a3-cd7d-49a2-8a6f-80671508d62f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.873747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da8a3-cd7d-49a2-8a6f-80671508d62f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.873825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da8a3-cd7d-49a2-8a6f-80671508d62f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.875868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 403/832] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:45.881162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.881562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.881746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.901003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:45.902211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:45.923407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 430/833] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:45 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:45.942885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da8a3-cd7d-49a2-8a6f-80671508d62f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.955225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da8a3-cd7d-49a2-8a6f-80671508d62f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.959738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.960554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.960842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.961120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:45.961789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:45.963491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:45.975833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:18:45.982460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 404/834] 10.222.0.65 () {56 vars in 1153 bytes} [Mon Feb 21 09:18:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:45.983824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:45.992893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15b1e-bdbd-4132-8bcd-47198d848269 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:45.998161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:45.998818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:45.999103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:45.999419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.000129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:46.000442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.002022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90612f3d-ae72-41bc-a4cb-f3e62806e01a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:46.011134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 431/835] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:46.012487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.023106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9621b-b307-4af6-a03b-86ef70bc55c0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.027777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.028429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.028718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.028999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.029704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:46.030014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.031671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156db18-e83f-4ccd-94c5-a5a4e4b912b8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:46.043887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 405/836] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:46.602420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1740d4-9fcd-4d07-9eb9-7ac7155be3fc None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.603042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1740d4-9fcd-4d07-9eb9-7ac7155be3fc None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.603583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1740d4-9fcd-4d07-9eb9-7ac7155be3fc None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.605826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 432/837] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:46.611146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.611691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.612210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.630020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:46.631576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:46.640310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 406/838] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:46 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:46.664318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1740d4-9fcd-4d07-9eb9-7ac7155be3fc None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.677070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1740d4-9fcd-4d07-9eb9-7ac7155be3fc None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.681740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.682758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.683241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.683739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.694446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:46.702094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:18:46.703526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 433/839] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:46.709434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.719482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b2a83-6393-40df-af4e-d7066e258086 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.724106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.724767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.725050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.725324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.726067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:46.726373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.727989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:46.737201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 407/840] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:46.742566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.753213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5cd1-17a4-414f-ba46-ec1f31ff2257 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.758132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.759167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.759681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.760170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.892274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.894951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:46.912343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:46.914193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 434/841] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:46.920348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.930614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2ffdd-70b1-4cc4-bb09-94422086cda5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.935972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.936953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.937440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.937931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.938860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:46.939407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.941274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:46.953761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 408/842] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:46.959596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:46.970303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f05573-b88e-4a03-b15b-ff0fed943d3d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:46.975286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:46.976382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:46.976904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:46.977378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:46.986297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:46.988645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.003344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:47.005099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 435/843] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.010940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.021388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790168f-d6e2-4d0a-b5d9-91220e412639 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.029359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.030282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.030797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.031270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.032376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.032885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.035036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.054011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 409/844] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.059933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.070376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed32a9-9d4d-4f6d-b6b1-add37f60266e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.075410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.076284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.076802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.077276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.085810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.087871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1272e-f306-4c7d-89ee-ad7823c19567 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.098295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 436/845] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:47.104153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.114853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ec26-3400-4809-9496-49524eb913d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.119734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.120803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.121344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.121868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.132607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.134740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.153161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89781-dbec-490f-aec4-a2dc3a00e1e9 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.153161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89781-dbec-490f-aec4-a2dc3a00e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.153161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe89781-dbec-490f-aec4-a2dc3a00e1e9 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.154720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 437/846] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:47.157020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:47.158535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 410/847] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.160531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.161055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.161523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.163916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.175520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda7070-67b9-44db-a076-7607a2ce626c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.180838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.181496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.181788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.182068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.182654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:47.182784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.183088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.184521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:47.184774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.193617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 438/848] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:47 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:47.198651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 411/849] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.204101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.214112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e92921-4b66-43e7-872a-cc69b41643bb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.219316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.220136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.220492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.220693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.222245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.228784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.231722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.232941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681ffeb-4d6e-4644-87bd-b4a77a91ace1 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.238061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.239441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.240008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.240498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.248062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:47.249977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 412/850] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.252554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:47.255522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.260117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:18:47.263127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 439/851] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.269000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.269934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0a99-4a82-4039-b923-c36b0e799a79 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.274719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.275453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.275741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.276021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.277367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.277716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.279890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.281072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685451-4fc7-460e-bdbe-02966c81ffda admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.286085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.287001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.287582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.288082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.289081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.289581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.291471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.293223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 413/852] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.298404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.310115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 440/853] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:47.310274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcee8b2-a996-4312-af31-43b0553730c0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.312089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.314539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.315333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.315846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.316218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.317153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=1914a3193cd74814b7344c15a1eb0beb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.317565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.319923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.323394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b5f2-7ca5-4e64-8b5e-bf30a9ed1580 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.327334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 414/854] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/role_assignments?user.id=1914a3193cd74814b7344c15a1eb0beb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:47.330551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.331658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.332179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.332656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.345175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.348374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.367872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:47.369844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 441/855] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:47.375665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.386224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760b5b0-36f3-4e69-a31c-5d08d3abc513 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.391950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.393104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.393625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.394109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.395154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.395818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.397843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.414516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 415/856] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.420607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.433399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403440f-3060-4b08-b0dc-6eb5d77d7d92 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.438627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.439471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.439755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.440028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.448766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.450851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.465744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:18:47.467334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 442/857] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.472945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.483761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b680-b44a-4496-9fcd-69e4726931e0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.488680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.489662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.490171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.490654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.491764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.492284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.494489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.517475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 416/858] 10.222.0.65 () {56 vars in 1156 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.523504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.534449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2520c-8e2e-43a8-aa73-3c1086fdc3bf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.539248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.540096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.540622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.541034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.550273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.552634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.563362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 443/859] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:47.568638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.582371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213e734-f139-42a2-ba6f-984d23b6d7bf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.591232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.592046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.592353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.592607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.603975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.606370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.624482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:47.626035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 417/860] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:47.631598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.644315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0f539-1436-4178-9506-90a01525340a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.649071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.649730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.650011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.650288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.651003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.651329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.653039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.666087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 444/861] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.671808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.681793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f49f14-eb78-4514-a500-ef12fa6668f5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.687100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.688061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.688346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.688618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.696180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.698219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.711485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:47.712968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 418/862] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.719191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.733527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ed550-d177-4a55-ab57-286b4c1a5684 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.738343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.739201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.739668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.740083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.741009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.741493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.743627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3120ae3-c9e4-4338-a577-7d8ced5f676a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.756785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 445/863] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.763137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.775915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae4113-bbed-47de-9923-972c079e8dc8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.781735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.782558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.783020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.783477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.784492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=5eccc516e4354bd78f33c775d7f2ac58) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.784941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.787036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1950a-b28f-48db-8cdb-ce50ba11ef62 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.792929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484e0a-d77d-432a-ba53-b236f98cce01 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.793866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484e0a-d77d-432a-ba53-b236f98cce01 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.794210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79484e0a-d77d-432a-ba53-b236f98cce01 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.795039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 419/864] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/role_assignments?user.id=5eccc516e4354bd78f33c775d7f2ac58&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.799386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 446/865] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:47.801994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.802312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.802565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.821295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:47.822521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:47.830977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 420/866] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:47 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:47.854190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79484e0a-d77d-432a-ba53-b236f98cce01 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.868244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79484e0a-d77d-432a-ba53-b236f98cce01 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.873874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.874870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.875307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.875695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.876546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.878437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.894228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:18:47.896634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 447/867] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:47.902411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.912740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753e876-81ac-4bb5-b0aa-bbd010e523e2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.917676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.919123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.919454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.919829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.920611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.921201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.922544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaaa4b-2702-4508-8e10-03f8c191d823 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.934686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 421/868] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:47.935764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:47.949180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad9367-d941-4846-842f-05b4e7960115 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:47.954244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:47.954922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:47.955509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:47.955806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:47.956531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:47.956845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:47.959634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e4b7f-d4a4-4bb5-aa1c-629e48c71731 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:47.966923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 448/869] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:48.450282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db479-d308-4a52-9afd-2276f240bb23 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:48.450662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db479-d308-4a52-9afd-2276f240bb23 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:48.450829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db479-d308-4a52-9afd-2276f240bb23 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:48.455531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 422/870] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:48.462145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28eb1c-95e5-4095-bbad-8605a00116ca None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:48.462445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28eb1c-95e5-4095-bbad-8605a00116ca None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:48.462733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28eb1c-95e5-4095-bbad-8605a00116ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:48.483424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0e28eb1c-95e5-4095-bbad-8605a00116ca None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:48.484628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0e28eb1c-95e5-4095-bbad-8605a00116ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:48.493097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 449/871] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:48 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:48.516867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db479-d308-4a52-9afd-2276f240bb23 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:48.529044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db479-d308-4a52-9afd-2276f240bb23 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:48.533417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:48.534066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:48.534351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:48.534621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:48.535375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:48.536973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf1c4-b761-4e61-8fb8-a1c9c6d28ea0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:48.632292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 423/872] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:48 2022] POST /identity/v3/services => generated 269 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:49.893832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbf5f-70c6-4a41-85c0-928c0c51553f None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:49.894409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbf5f-70c6-4a41-85c0-928c0c51553f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:49.894409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbbf5f-70c6-4a41-85c0-928c0c51553f None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:49.896466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 450/873] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:49.901783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:49.902199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:49.902373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:49.920929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:49.922103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:49.940355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 424/874] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:49 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:49.964107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbbf5f-70c6-4a41-85c0-928c0c51553f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:49.977570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbbf5f-70c6-4a41-85c0-928c0c51553f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:49.982979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:49.984071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:49.984564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:49.985043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:49.996023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:50.007170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:18:50.014750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 451/875] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:18:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:50.016733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.026926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ce9ce-09bf-499a-ab0a-42dc7b61bb12 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.032344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.033229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.033748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.034226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.035185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.035735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.037553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.051066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 425/876] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.052680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.063484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c8196-0ffe-4063-a1a9-0e3259d58442 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.068445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.069444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.069952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.070432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.081166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.083229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.100844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:50.107490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 452/877] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:50.109024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.119180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7deb1-d813-4dfb-a8b9-4dfedfbd80e0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.124054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.124709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.124995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.125273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.125998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.126305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.127965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d6e67-7079-4096-842c-5a67e2bdd533 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.140318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 426/878] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.155975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.161438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59277f-32ae-43b7-a7aa-9d9d90c48e6b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.166303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.167267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.167747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.168230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.176725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.178962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.193958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:50.199372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 453/879] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:50.201244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe6a-d478-4026-b198-49dacfa67f43 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.201751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe6a-d478-4026-b198-49dacfa67f43 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.202253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6fe6a-d478-4026-b198-49dacfa67f43 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.205525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 427/880] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:50.206532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.216454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.217031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.217139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91348e26-e34d-48d5-9276-a65cc37fb8e3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.217712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.221833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.222594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.222878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.223152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.224016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.224324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.226273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.238621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:50.240167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:50.246827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 454/881] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:50.252820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.259483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 428/882] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:50 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:50.262907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dae94-9c89-4d58-924c-cb9c0a986ec1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.267855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.268513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.268801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.269080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.277994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.279818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.281886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.295332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 455/883] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:18:50.295509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743ab27-f06a-441f-b90e-88f6f96f5e18 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.300462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.304572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.305684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.306228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.306705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.307996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.311054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.312012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fec1-409e-4830-b7a9-8d73257e0f23 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.317042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.317822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.318112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.318396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.322666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-ec3350bb-d2ea-4a4d-9606-cc83f0958316 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:18:50.324034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 429/884] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:50.328664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d080-5a35-4f35-95d8-4e0e430e75b1 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.328957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d080-5a35-4f35-95d8-4e0e430e75b1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.329237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0d080-5a35-4f35-95d8-4e0e430e75b1 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.331028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 430/885] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:50.334907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d080-5a35-4f35-95d8-4e0e430e75b1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.335023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.335479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.347937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0d080-5a35-4f35-95d8-4e0e430e75b1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.352263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.352877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.352977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f5823fec-6fdd-4dde-841f-962568ee19de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:50.353164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.353441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.354252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 456/886] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:50.354363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.354436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.356065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.357168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.357982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.358481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.360921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 431/887] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.361675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.374110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12ecb-de20-44b0-81ee-250feebb06e8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.378255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:50.378622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.379252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.379569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.379844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.380562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.380773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:50.380873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.382445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.398744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 457/888] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:50 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:50.398744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.401305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d90df-028a-49a3-bc0c-41646dffced4 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.402502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 432/889] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.408921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.413420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.414366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.414862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.415469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.416367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.416745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.418330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.419229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a692be-6f8e-4a18-8fb2-a31572122c20 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.423224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 458/890] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.423789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.424561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.424847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.425126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.432346 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.432635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.434591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.446786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9dc5-9b37-41e6-995c-4f733daed894 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.448809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:50.450951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 433/891] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:50.453219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.453892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.454178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.454454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.455177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.456820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689abb63-ff34-4eab-b358-a56ecece5d22 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.457123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.468948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24edc28-0a00-4465-8c51-5e20222f3bf5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.474071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.474823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.475117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.475440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.482423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.482423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.482423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.500855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 434/892] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:50.502198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:50.513396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3ed1-5381-4ae1-8167-f2fae3b4a478 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:50.518668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:50.519375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:50.519670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:50.522199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:50.522199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] RBAC: Adding query filter params (role.id=aac8be11260a4593b3bdb47cbda7c67c, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=1914a3193cd74814b7344c15a1eb0beb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:50.522199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:50.523492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65689f83-7beb-4e87-bbce-a5ea92fd3fcf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:50.530669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 435/893] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:50 2022] GET /identity/v3/role_assignments?user.id=1914a3193cd74814b7344c15a1eb0beb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=aac8be11260a4593b3bdb47cbda7c67c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:50.553127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 459/894] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:50 2022] POST /identity/v3/services => generated 251 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:51.028445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af653-20a8-46ed-9630-6dd5980dbae3 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.028977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af653-20a8-46ed-9630-6dd5980dbae3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.028977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491af653-20a8-46ed-9630-6dd5980dbae3 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.031004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 436/895] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:51.036256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.036650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.036811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.054128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:51.055289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:51.072312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 460/896] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:51 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:51.094946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af653-20a8-46ed-9630-6dd5980dbae3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:51.107364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491af653-20a8-46ed-9630-6dd5980dbae3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:51.111702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:51.112486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.112768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.113043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.113683 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:51.115261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:51.126843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:18:51.128254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 437/897] 10.222.0.65 () {56 vars in 1153 bytes} [Mon Feb 21 09:18:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:51.133769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:51.143005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1120-8c6e-49f1-8a4e-373e22fe88a8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:51.147580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:51.148228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:51.159292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 461/898] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:51.161627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:51.171828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e4f4b-82c2-42b6-999a-317c93e8416b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:51.178049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:51.178819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.179109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.179420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.180380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:51.180689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:51.182351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:51.188737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 438/899] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:51.193996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:51.203835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2533ee7-e8f0-49ad-8caa-9a2bf96ee4b0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:51.208399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:51.209039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.209320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.209592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.210367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] RBAC: Adding query filter params (interface=public, service_id=c5feaf05fb864770ad7761f6fe84bb6f, region_id=RegionOne) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:51.210674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:51.211744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:18:51.211744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:18:51.211744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:18:51.212638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692ad13-ca79-4395-a858-3807e825ac01 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:51.220315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 462/900] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:18:51 2022] GET /identity/v3/endpoints?service_id=c5feaf05fb864770ad7761f6fe84bb6f&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:51.225752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:51.235870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4a24-ee19-4bd7-85ca-ebeed1b8720c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:51.240375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:51.241019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:51.241301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:51.241573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:51.242245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:51.243871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e7237-c2e9-4818-b75b-2d7dfaf79297 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:51.250170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 439/901] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:18:51 2022] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:18:52.848849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf218-e926-42eb-aa07-f70165c64e2c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.849554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf218-e926-42eb-aa07-f70165c64e2c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.849554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcf218-e926-42eb-aa07-f70165c64e2c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.851422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 463/902] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:52.857205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.857694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.857856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.876714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:52.877902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:52.882331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a74d3-1cff-4bda-bba9-549b057543b1 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.882523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a74d3-1cff-4bda-bba9-549b057543b1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.882803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a74d3-1cff-4bda-bba9-549b057543b1 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.884883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 464/903] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:52.885836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 440/904] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:52 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:52.889876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f70d5-4773-4756-b48e-f9543264a9dc None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.890168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f70d5-4773-4756-b48e-f9543264a9dc None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.890450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f70d5-4773-4756-b48e-f9543264a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.908481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-022f70d5-4773-4756-b48e-f9543264a9dc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:52.909678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-022f70d5-4773-4756-b48e-f9543264a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:52.911815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:52.918962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 465/905] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:52 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:52.922424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-066d-435d-ba48-20919c5e0a2a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.922424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-066d-435d-ba48-20919c5e0a2a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.922424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-066d-435d-ba48-20919c5e0a2a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.922424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 466/906] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:52.923143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf43172-1905-41ab-afd7-642c2fdce22e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:52.929067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.929341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.929619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.931699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:52.932590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.933161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.933638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.935261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:52.937082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:52.949164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:52.950456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:52.958012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 467/907] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:52 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:52.960154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:52.969855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af697b-41e5-4cde-9a8f-5f4b12445dbf None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:52.974456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:52.975236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:52.975543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:52.975823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:52.986828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:52.994212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:18:53.000046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 468/908] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:18:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.000046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.005464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e70eb8-05b8-41c2-8859-3411e1ddb19d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.009769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.010498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.010779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.011049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.011825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.013404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.025075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:18:53.026184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 441/909] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:52 2022] POST /identity/v3/services => generated 241 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:53.031431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.031575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 469/910] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.032798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.045527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1819c-a987-4dcf-849f-6d72afdf3d38 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.056949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f647f3-1eb2-4f40-b9ea-42a7f5cae879 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.060427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.061097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.061378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.061654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.062361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.062666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.063282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.064091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.064420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.064520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.064789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.066118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.066863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.068990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.074861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 470/911] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:53.076293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.079198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 442/912] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:53.084877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.088265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31432ce3-ae43-49f3-bea1-13ba707b7743 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.093722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.094690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.095172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.095699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.095960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b8453-1d9d-435e-ab5a-4a7be96a955b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.096950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.097599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.099723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.100825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.101922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.102215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.102493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.111800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 471/913] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:53.114551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.116125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.118216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.125060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10567a-9439-45a5-b53d-9498207a4a4e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.129877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.130549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.130835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.131113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.131964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] RBAC: Adding query filter params (interface=public, service_id=831a08c1f4064d788c167d4565c799c5, region_id=RegionOne) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.132278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.133904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.138550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:53.145117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 472/915] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/endpoints?service_id=831a08c1f4064d788c167d4565c799c5&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:53.145457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 443/915] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.146579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.147140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.157743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd211518-e632-431d-ab50-aba8589cf927 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.158037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321540c4-6d4b-459b-9b8b-7c838c0b35c2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.162811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.163619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.163976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.164235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.164378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.165098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.165392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.165840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.166277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.167118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.167392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.167867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.170328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.181569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 473/916] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:18:53.187491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 444/917] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:53.191145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.209273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa62631-8e6e-41ab-b903-ffb1855fa686 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.214378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.215829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.216198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.216481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.226286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.228480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.245359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:53.246694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 474/918] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.252919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.263494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c8798-0e3b-40da-81d5-953f2e9b96f8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.269735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.270766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.271281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.271796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.272866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.273394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.275582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.297939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 445/919] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:53.306732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.314758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96c387-8a8c-4378-9670-36e3d210e81a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.319636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.320451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.320735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.321015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.333516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.335424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.355000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:53.356560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 475/920] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.361965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.371969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa477ed-ee93-4e55-8071-6174fb94777a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.378443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.379114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.379438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.379718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.380441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.380750 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.382344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.397476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 446/921] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:53.400946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.412146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e794ffc-a6ef-42c3-9253-e70a68d006c3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.416777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.417653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.418003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.418408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.426033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.428128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.441589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:53.447492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 476/922] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.448856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.459205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a0d16-6b3f-4bab-9bb1-fb38a788a1f0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.463666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.464317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.464597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.464868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.466259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.466571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.468428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d76e8-dc82-47f4-8c8f-b0463aa92587 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.485607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 447/923] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:53.486942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.497548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89c449-c595-4f83-8571-fba7d60efe50 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.502208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.505531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.505531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.505531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/1914a3193cd74814b7344c15a1eb0beb/roles/aac8be11260a4593b3bdb47cbda7c67c` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.506056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=1914a3193cd74814b7344c15a1eb0beb, role_id=aac8be11260a4593b3bdb47cbda7c67c)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.511265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbd4bc-0e58-431d-8c90-cf67a69cb5ef admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.593423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 477/924] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:18:53 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/1914a3193cd74814b7344c15a1eb0beb/roles/aac8be11260a4593b3bdb47cbda7c67c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:18:53.601029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bdd8c-ad11-454d-9ca2-854e942c4912 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.601312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bdd8c-ad11-454d-9ca2-854e942c4912 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.601664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bdd8c-ad11-454d-9ca2-854e942c4912 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.603422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 448/925] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:53.610080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.610691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.611163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.631281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:53.632900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:53.697574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 478/926] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:53 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:53.722711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bdd8c-ad11-454d-9ca2-854e942c4912 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.735623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bdd8c-ad11-454d-9ca2-854e942c4912 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.740214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.741082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.741367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.741644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.742359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.744095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.757202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:18:53.758842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 449/927] 10.222.0.65 () {56 vars in 1153 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:53.765561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.775353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d37bb-c800-42be-b596-04393ee2e35f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.780500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.781314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.781693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.782065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.783029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.783371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.785119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.790852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 479/928] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:53.796737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.809569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa258f02-b4e0-471f-8230-a1424d30e881 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.814317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.815113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.815440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.815717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.816480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:53.816784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.818548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03518d6-70db-4efe-949e-35508b00ab92 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.826380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 450/929] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:53.831957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:53.841966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef06fd1-c876-4243-9e27-9a04e93892f3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:53.846653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:53.847478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:53.847761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:53.848035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:53.848835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:53.850536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee93e9-ab31-40a8-b26b-8ba8686cf518 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:53.953370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 480/930] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:18:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:55.420908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58fa0-cdbb-4fc7-a15c-2f3b0021f25a None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.421424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58fa0-cdbb-4fc7-a15c-2f3b0021f25a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.421501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa58fa0-cdbb-4fc7-a15c-2f3b0021f25a None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.423406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 451/931] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:55.428971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.429396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.429620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.450053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:55.451254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:55.469089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 481/932] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:55 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:55.492088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa58fa0-cdbb-4fc7-a15c-2f3b0021f25a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.504860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa58fa0-cdbb-4fc7-a15c-2f3b0021f25a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.509337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.510129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.510412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.510689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.511371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.513541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.525204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:18:55.526719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 452/933] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:55.532659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.541816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a478ac1-6a4b-4f4a-b8a0-bd03cb388338 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.546788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.547647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.547937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.548212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.548924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:55.549227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.550866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.556383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 482/934] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:55.562573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.573361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bd0cd-516f-440d-8223-bfed0cb1b382 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.578743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.579467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.579755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.580034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.580761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:55.581069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.582730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0f1e0-299f-47c1-814f-c51a33b8a8ce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.588875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 453/935] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:55.594826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.598668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96ee-e36a-444e-b58a-a461c2541735 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.598954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96ee-e36a-444e-b58a-a461c2541735 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.599210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d96ee-e36a-444e-b58a-a461c2541735 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.601352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 454/936] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:55.606296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04dd75-8411-4a9a-9a5f-85189bfeff1a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.607447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.607741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.608019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.611033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.611775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.612068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.612342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.613130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] RBAC: Adding query filter params (interface=public, service_id=ff6a3e853a8448768a6138b07cdfc29d, region_id=RegionOne) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:55.613441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.615039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.620904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 483/937] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/endpoints?service_id=ff6a3e853a8448768a6138b07cdfc29d&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:55.626876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.627685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:55.629047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:55.636701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc994-b2a2-49cf-9ea6-2be6414401e6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.637533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 455/938] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:55 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:55.643317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.643317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.643317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.643317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.651842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.653658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.661824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 484/939] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services => generated 1497 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:18:55.662030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.672129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203ce8-e473-44a8-b465-13bb35177eb9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.676882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.677699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.677980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.678251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.678993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.680725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.698656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:18:55.700377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 456/940] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:55.706320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.720616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10dd73-851b-4a2d-8808-74b47a2d964b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.725586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.726532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.726991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.727478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.728372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:55.728857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.731392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.737349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 485/941] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:55.743345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.754477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e927f3e-3834-42c0-a635-756a6d98de46 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.759538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.760355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.760728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.761075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.761912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:55.762285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.764071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173150-54cb-40a2-bb83-1a07e8e97ed6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.770550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 457/942] 10.222.0.65 () {56 vars in 1135 bytes} [Mon Feb 21 09:18:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:55.776438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:55.787251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fefec-711f-44e6-8b57-39f1e5bef966 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:55.792338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:55.793610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.793899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.794229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.794980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:55.796686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e60c8-a743-4538-810e-d54bb348fc82 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:55.879405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 486/943] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:18:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:18:55.970916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705e0a-ddf8-4591-abc3-2862851c6c8c None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.971219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705e0a-ddf8-4591-abc3-2862851c6c8c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.971437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43705e0a-ddf8-4591-abc3-2862851c6c8c None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.973555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 458/944] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:55.979312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:55.979608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:55.979890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:55.999367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:56.000633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:56.019691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 487/945] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:55 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:56.044776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43705e0a-ddf8-4591-abc3-2862851c6c8c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.057705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43705e0a-ddf8-4591-abc3-2862851c6c8c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.062367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.063185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.063495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.063770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.077236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:18:56.085025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:18:56.088681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 459/946] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:56.093950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.103164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c138-f24a-48d3-9d4b-678cc0bd9272 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.108382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.109057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.109340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.109615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.110373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.110678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.112302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.121165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 488/947] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.126719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.140803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e751562-c41e-4f92-b422-a57590e72e3f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.145868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.146666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.146944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.150781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.158647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.160541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.178321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:56.179848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 460/948] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:56.185296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.195084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b3448-3a26-4c1d-b729-d37a07cc06c6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.199675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.200324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.200608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.200886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.201601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.201907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.203522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.216234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 489/949] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.222239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.233131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f851f20-a647-44ed-a35e-a53255add714 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.238188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.239223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.239707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.240174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.248231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.250485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.265714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:18:56.267698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 461/950] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:56.273561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.284924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f432ec-89a9-49f5-bb53-2066e37e7a71 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.290262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.291132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.291641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.292249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.294082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.294560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.296653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.315558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 490/951] 10.222.0.65 () {56 vars in 1170 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.321571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.333179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086de4f-8d8d-4122-bce1-650c9cb15fe6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.339257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.341225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.342009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.347457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.351871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.353886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8cc1-1097-4538-9e12-935313538fc6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.364547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 462/952] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:18:56.370713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.381588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60a41b-13e7-41cd-9dee-664aaa3357be admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.387882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.389492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.390225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.390810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.404609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.409399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.426850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:18:56.428811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 491/953] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:56.434544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.435202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864255b7-f771-4f9d-9f55-857288a8514a None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.435570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864255b7-f771-4f9d-9f55-857288a8514a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.435766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864255b7-f771-4f9d-9f55-857288a8514a None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.438995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 463/954] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:56.443538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.443952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.444239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.447544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a756fb-e25d-43d6-bba6-814727f6b304 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.454058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.454956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.455486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.455936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.456830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.457309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.459687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.463809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:56.465603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:56.473611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 492/955] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:56.478212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 464/956] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:56 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:56.479259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.488931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacbeb4-0e1e-4510-87b0-7c65ec75a608 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.493594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.494557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.495011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.495484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.498140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.509547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.510540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8407d4-274c-4b6a-91b7-d9f932c1465b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.512608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.516452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.517245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.517528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.517852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.518509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.520179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.529692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:56.535581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:18:56.535581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 465/958] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:56.535773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 493/958] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:56.540293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.545324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.550159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c03b8-da09-4a00-b55a-325ce029aa7b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.559066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.560030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.560532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.561109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.562660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.563278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.566497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.579072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0927b-2c83-40eb-91b8-18d2d3c61963 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.584055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.584785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.585472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.585472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.586249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.586584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.588316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.594772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 466/959] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.595986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.599104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 494/960] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.604366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:56.608515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79adc-bae0-46eb-8a95-dcab4accd38e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.613347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.614094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.614227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39476c4-39ab-463b-8837-76e8bd9b10fd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:56.614577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.614951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.616006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] RBAC: Adding query filter params (role.id=aac8be11260a4593b3bdb47cbda7c67c, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=1914a3193cd74814b7344c15a1eb0beb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.616548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.618709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854b5eb-4417-43dc-a22b-8612926fd351 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.618938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:56.619618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:56.619956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:56.620236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:56.621052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:56.621308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:56.622935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4932150-e59f-4ac3-9899-b27d0c635202 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:56.626196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 467/961] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/role_assignments?user.id=1914a3193cd74814b7344c15a1eb0beb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=aac8be11260a4593b3bdb47cbda7c67c => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:56.643498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 495/962] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:58.092896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d126e-b4a1-4346-85c4-40a5249458be None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.094205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d126e-b4a1-4346-85c4-40a5249458be None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.094708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d126e-b4a1-4346-85c4-40a5249458be None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.096966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 468/963] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:58.102778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.103693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.104181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.127542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:58.130265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:58.141590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 496/964] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:58 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:58.171613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d126e-b4a1-4346-85c4-40a5249458be None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.188307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d126e-b4a1-4346-85c4-40a5249458be None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.193266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.194458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.194883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.195319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.196346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.198902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.214744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:18:58.217107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 469/965] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:18:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:58.226197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.237261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ef77-00e5-4ae4-8b00-b4a891800226 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.242259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.243241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.243752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.244233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.245163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:58.245677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.247569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.253531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 497/966] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:58.259428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.270053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d28de-7bbd-45d2-9491-ea0f7e765d0c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.274992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.275960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.276447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.276935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.278453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:58.278972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.280810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2041f-360a-4c9b-8e26-5044998e193e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.286785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 470/967] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:18:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:58.292595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.303575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8670-5582-4189-b6b9-defdfdf96ebf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.313866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.314867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.315384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.315858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.316828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.318661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.357590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc85a-f934-4168-9e07-58a74141e5bc None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.357874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc85a-f934-4168-9e07-58a74141e5bc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.358053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc85a-f934-4168-9e07-58a74141e5bc None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.359848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 471/968] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:18:58.365131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.365418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.365693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.383953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:58.385154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:58.393331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 472/969] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:58 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:58.419271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.422233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 498/970] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:18:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:58.431163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ffbf8-5e1b-4622-95da-3e385c0b6c9d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.448319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.449481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.449975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.450541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.451533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.453883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.455656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.common [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 09:18:58.505859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.sql.core [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 21 09:18:58.505859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 21 09:18:58.505859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [parameters: {'id': 'd4b66acfb2c84738bc5f054ff4cdd901', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 21 09:18:58.505859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79601) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:18:58.522829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d4b66acfb2c84738bc5f054ff4cdd901.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d4b66acfb2c84738bc5f054ff4cdd901. Feb 21 09:18:58.525069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 473/971] 10.222.0.65 () {60 vars in 1161 bytes} [Mon Feb 21 09:18:58 2022] POST /identity/v3/projects => generated 262 bytes in 106 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:58.532245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.544734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a718aa5-506d-4e6c-89ed-a123704f9433 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.551010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.552235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.552773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.553354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.562167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.564624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.587069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-474ba7f0-4045-485e-b6ff-ffe506d73c35 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:18:58.589612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 499/972] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:18:58.599862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:58.618348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36e2de-300a-4786-8558-dd62fbf32236 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:58.625105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:58.625781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:58.626128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:58.626515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:58.627831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:58.628319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:58.632579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40a908-ba67-4447-9199-f626075f9129 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:58.674180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 474/973] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:18:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:18:59.012671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e8d1-20d1-4ddc-8b90-a4d309a42c7f None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.013012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e8d1-20d1-4ddc-8b90-a4d309a42c7f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.013201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728e8d1-20d1-4ddc-8b90-a4d309a42c7f None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.015180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 500/974] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:59.021110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.021406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.021687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.039926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:59.041456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:59.049782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 475/975] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:59 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:18:59.071203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f3802-e252-446d-aad8-64f60bc9e790 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.071679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f3802-e252-446d-aad8-64f60bc9e790 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.072335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f3802-e252-446d-aad8-64f60bc9e790 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.073030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:59.075119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 501/976] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:18:59.080879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.081166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.081444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.083540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13830c4b-9b99-4261-8a08-d57985b53522 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:59.088442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:59.089139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.089406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.089684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.090467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:59.092132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:59.100595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:18:59.102043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:18:59.109902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 502/977] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:18:59 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:18:59.133462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:59.143629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4ad1-e441-4332-8aed-5993fcd5f34c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:59.148112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:59.149732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.149732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.149732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] PATH_INFO: `/v3/services/image` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.150077 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:59.151690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:59.163006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:18:59.167335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 503/978] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Feb 21 09:18:59 2022] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:18:59.171615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:59.176517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 476/979] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:18:59 2022] POST /identity/v3/services => generated 242 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:18:59.183288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5181-8300-4e94-9fdc-bec0c2b46cbb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:59.200610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:59.201299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.201587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.201869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.202595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:59.202908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:59.204617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc031aed-05d9-49f6-9294-fa46d6dba878 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:59.210842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 504/980] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:18:59.216936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:18:59.228113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627b6d7-aa5d-48ec-8211-6a9dbc9a6509 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:18:59.232920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:18:59.233611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:18:59.233900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:18:59.234179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:18:59.234914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:18:59.235226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:18:59.237015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e215-ffb8-4750-9a4b-2dbabbee1462 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:18:59.243143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 477/981] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:18:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:00.849875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8008297-6622-4a4e-863f-9738245d6ee6 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:00.850419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8008297-6622-4a4e-863f-9738245d6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:00.850419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8008297-6622-4a4e-863f-9738245d6ee6 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:00.852517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 505/982] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:00.858342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:00.859159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:00.859630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:00.878828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:00.880082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:00.889184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 478/983] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:00 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:00.913014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8008297-6622-4a4e-863f-9738245d6ee6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:00.929240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8008297-6622-4a4e-863f-9738245d6ee6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:00.934795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:00.935669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:00.935956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:00.936237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:00.936904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:00.938529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:00.951972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:19:00.958627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 506/984] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:19:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:00.960354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:00.970630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295feaa-1db9-46ac-bac1-b861234b68cc None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:00.975833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:00.976881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:00.977369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:00.977845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:00.978768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:00.979278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:00.981315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:00.991424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 479/985] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:19:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:00.994035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.005108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477b73-53a3-4e7e-a733-4eb1cd0dfe6c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.010177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.011133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.012192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.012670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.013581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.014088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.015977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.026989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 507/986] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:19:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:01.029236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.039770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2f92-15f4-4d27-a7ae-3e1e37ccda1c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.044897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.045905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.046393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.046883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.047928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] RBAC: Adding query filter params (interface=admin, service_id=ff6a3e853a8448768a6138b07cdfc29d, region_id=RegionOne) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.048481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.050329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd2909-3d24-4182-b321-e3340255873c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.061132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 480/987] 10.222.0.65 () {56 vars in 1270 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/endpoints?service_id=ff6a3e853a8448768a6138b07cdfc29d&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:01.062894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.073366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97331-7334-4e36-adf8-eab413a7335e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.078999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.079948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.080446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.080944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.081825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.084198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15892b-7f36-48ae-a734-2b9dbf3d7e29 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.084568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.084934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15892b-7f36-48ae-a734-2b9dbf3d7e29 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.085458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15892b-7f36-48ae-a734-2b9dbf3d7e29 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.087763 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 481/988] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:19:01.093917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.094208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.094490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.097364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 508/989] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/services => generated 1727 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:19:01.114286 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:01.115542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:01.124402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 482/990] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:01 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:01.156857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.168155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4b8ca-5092-4485-b09f-19159721ce17 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.173871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.174975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.175502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.176005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.176983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.179375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.187013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.common [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 09:19:01.225752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.sql.core [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 21 09:19:01.225752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 21 09:19:01.225752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [parameters: {'user_id': 'e024d5a0fda24fc7b9e1fdbfef5aa140', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 21 09:19:01.225752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:19:01.232668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 21 09:19:01.234939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 509/991] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:19:01 2022] POST /identity/v3/users => generated 160 bytes in 78 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:01.241922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.252591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbc919-76ed-447a-abc1-3f22e76b5433 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.257819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.258835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.259125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.259492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.269269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.271619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.289757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-462da1a7-6b26-4a57-b29f-81364e4fc396 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:19:01.291492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 483/992] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:01.297449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.309381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058aca-36c0-43b2-9c88-f4f2664d33a8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.315420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.316566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.317075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.317531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.318586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.319092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.321590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d58734-e844-4d22-85a5-5076ece2012d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.366149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 510/993] 10.222.0.65 () {56 vars in 1122 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:01.632024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f44e-a5e9-4c33-a798-6634a37aebf1 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.632341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f44e-a5e9-4c33-a798-6634a37aebf1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.632509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87f44e-a5e9-4c33-a798-6634a37aebf1 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.634496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 484/994] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:01.640361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b93ba-6ef6-478c-89c3-43d1eea49e2d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.640938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b93ba-6ef6-478c-89c3-43d1eea49e2d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.641684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b93ba-6ef6-478c-89c3-43d1eea49e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.660035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e57b93ba-6ef6-478c-89c3-43d1eea49e2d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:01.661552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e57b93ba-6ef6-478c-89c3-43d1eea49e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:01.670042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 511/995] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:01 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:01.693384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f44e-a5e9-4c33-a798-6634a37aebf1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.696570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e318a-4330-4a90-820b-8de74f3d6dc7 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.696871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e318a-4330-4a90-820b-8de74f3d6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.697154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e318a-4330-4a90-820b-8de74f3d6dc7 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.698957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 512/996] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:19:01.704230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.704523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.704859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.706306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87f44e-a5e9-4c33-a798-6634a37aebf1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.710595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.711420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.711705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.711980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.712642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.714262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.723412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:01.724841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:01.725401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:19:01.726582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 485/997] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:01.732979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.734493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 513/998] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:01 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:01.742635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db204-9811-47d6-b3f4-28d8cf2172f5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.747672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.748320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.748606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.748882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.749590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.749897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.751521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.756655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 486/999] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:01.762316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.764233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.772277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be66ef6-ac70-4823-8d21-2b07760559db None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.774100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8d62-564e-4e01-8655-fc20a2ebe644 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.776727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.777429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.777720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.777986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.778697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.779004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.779111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.779746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.780034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.780309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.780643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.781032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.782616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e812b-d754-4d15-8475-8de6294fa4e9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.786396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 514/1000] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:01.792114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.802131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d1b8c-5173-47f6-be1c-5c40fb61e336 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.806879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.807556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.807842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.808119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.809465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] RBAC: Adding query filter params (interface=public, service_id=381ce183c05d4fc1bf6b1c7f67c70696, region_id=RegionOne) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:01.809772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.811472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.816877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 515/1001] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/endpoints?service_id=381ce183c05d4fc1bf6b1c7f67c70696&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:01.822237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:01.831683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfc7b5-155a-4f07-b469-28016c1dccd1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:01.836192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:01.836836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:01.837116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:01.837389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:01.838060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:01.839668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec2a7c-e14a-4d92-af81-2c2a31be75f4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:01.846183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 516/1002] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:19:01 2022] GET /identity/v3/services => generated 1727 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:19:01.856437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 487/1003] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:19:01 2022] POST /identity/v3/services => generated 242 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:19:03.521445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91904d-4f70-41d1-8b20-3cc6fe45ca1d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.521971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91904d-4f70-41d1-8b20-3cc6fe45ca1d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.522079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91904d-4f70-41d1-8b20-3cc6fe45ca1d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.524057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 517/1004] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:03.529927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.530401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.530502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.549006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:03.550198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:03.571344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 488/1005] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:03 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:03.591537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91904d-4f70-41d1-8b20-3cc6fe45ca1d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:03.604693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91904d-4f70-41d1-8b20-3cc6fe45ca1d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:03.609984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:03.610873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.611229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.611709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.612513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:03.614231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:03.626591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:19:03.628107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 518/1006] 10.222.0.65 () {56 vars in 1147 bytes} [Mon Feb 21 09:19:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:03.633822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:03.644329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20873fb3-bc7b-4557-a72c-27fe82d4d6df None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:03.649222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:03.649883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.650169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.650449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.651170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:03.651511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:03.653648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:03.659220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 489/1007] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:19:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:03.665473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:03.677906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d8b9c-6d2d-4980-a936-fa354a6856c1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:03.682707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:03.683539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.683897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.684243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.685042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:03.685425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:03.687098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16b257-cf0b-40dd-b94c-3a1f3219315e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:03.692612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 519/1008] 10.222.0.65 () {56 vars in 1143 bytes} [Mon Feb 21 09:19:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:03.698117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:03.708000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86124db5-6fc3-48dc-9449-1c0e7d0bc850 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:03.712492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:03.713147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:03.713437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:03.713723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:03.714490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:03.716085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:19:03.716085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:19:03.716085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:19:03.716971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c922-d02c-4e60-b604-adac98d11f01 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:03.799205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 490/1009] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:19:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:04.204349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d03-17df-48c9-8943-5e7e122cf091 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.204741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d03-17df-48c9-8943-5e7e122cf091 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.204951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9d03-17df-48c9-8943-5e7e122cf091 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.206850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 520/1010] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:04.212187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1125e-ac7d-49b4-bd1c-3bc286a25f3b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.212784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1125e-ac7d-49b4-bd1c-3bc286a25f3b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.212784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1125e-ac7d-49b4-bd1c-3bc286a25f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.230475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-66f1125e-ac7d-49b4-bd1c-3bc286a25f3b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:04.231691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-66f1125e-ac7d-49b4-bd1c-3bc286a25f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:04.249260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 491/1011] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:04 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:04.249821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538dde-7ad2-425a-bb11-a9c3ca8c5037 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.250188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538dde-7ad2-425a-bb11-a9c3ca8c5037 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.250584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538dde-7ad2-425a-bb11-a9c3ca8c5037 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.252814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 521/1012] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:19:04.257976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.258274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.258623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.273507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538dde-7ad2-425a-bb11-a9c3ca8c5037 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.278032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:04.279225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:04.287484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 492/1013] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:04 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:04.295760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538dde-7ad2-425a-bb11-a9c3ca8c5037 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.302930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.304491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.305178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.305844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.307188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.311197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.313237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.320257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ef06-bb72-46ee-a104-4cab13356ddb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.325606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.326376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.326659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.326979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] PATH_INFO: `/v3/services/image` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.327665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.329322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.333971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:19:04.336383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 522/1014] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:04.340427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:19:04.341590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 493/1015] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:04.342385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.347120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.353024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d4ea-1703-4208-89bb-de53d07aa70a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.357029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebed5-7d11-44bc-99eb-4961dda01ede admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.357617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.358379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.358745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.359037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.359780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:04.360090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.362193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.362718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.363517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.363899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.364279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.364985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:04.365293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.378775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.378975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 523/1016] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:04.379066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 494/1017] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:04.379137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.379820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.389255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d2eab-e1b8-418c-ac82-ad1ca31a118d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.389967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c8e4d-defb-46b8-89a8-32bbe13b8e40 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.394259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.394686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.394932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.395207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.395403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.395557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.395648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.395946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.396311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:04.396620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.396720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:04.396973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.398303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.398626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.403591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 524/1018] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:04.404212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 495/1019] 10.222.0.65 () {56 vars in 1133 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:04.409335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.409573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.419786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cdd8a-04be-416d-9c81-81a17c602f1a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.420510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4133-a0bf-426c-ad66-d598ece94295 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.424296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.424947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.425229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.427950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.428083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.428172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.428256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.428355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.428355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.428355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] RBAC: Adding query filter params (interface=public, service_id=33101aeaf0714c28b4316272e5c741bf, region_id=RegionOne) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:04.428355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.428664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd8220-47af-4c2a-944e-fa0664f457f1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.430183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.447648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 525/1020] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/endpoints?service_id=33101aeaf0714c28b4316272e5c741bf&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:04.448947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:04.463748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9d3e5-650a-4afa-b8c9-f9f12db7267a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:04.468744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:04.469414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:04.469696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:04.469978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:04.470660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:04.472295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609af7c-b10c-4919-b0d9-c0776a71b4aa admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:04.479226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 526/1021] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:19:04 2022] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:19:04.520223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 496/1022] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:19:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:19:06.228621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a445f7-19b8-4ed4-a0ca-1bde0690a7db None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.229145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a445f7-19b8-4ed4-a0ca-1bde0690a7db None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.229256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a445f7-19b8-4ed4-a0ca-1bde0690a7db None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.231724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 527/1023] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:06.237301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285018-a9c4-4351-b454-59825165cce9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.237775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285018-a9c4-4351-b454-59825165cce9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.237852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285018-a9c4-4351-b454-59825165cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.256390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-32285018-a9c4-4351-b454-59825165cce9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:06.257578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-32285018-a9c4-4351-b454-59825165cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:06.275034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 497/1024] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:06 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:06.298980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a445f7-19b8-4ed4-a0ca-1bde0690a7db None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:06.311959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a445f7-19b8-4ed4-a0ca-1bde0690a7db None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:06.316322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:06.317110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.317392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.317665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.318835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:06.320551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a8862-f4a3-4c17-9220-1990b1af0989 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:06.322334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 528/1025] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:06.328003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285018-a9c4-4351-b454-59825165cce9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:06.337272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285018-a9c4-4351-b454-59825165cce9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:06.341877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:06.342540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.342825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.343101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.343857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:06.345762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c811b-2f14-416b-919a-5d5f4ddafbe5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:06.472990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 498/1026] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:19:06 2022] POST /identity/v3/projects => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:06.872778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e987b-47f2-4dbc-9166-4c86c4a82089 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.873135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e987b-47f2-4dbc-9166-4c86c4a82089 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.873342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e987b-47f2-4dbc-9166-4c86c4a82089 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.875144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 529/1027] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:06.880711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66278db-672b-48bb-9c21-5fcfe43a4c2b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.881011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66278db-672b-48bb-9c21-5fcfe43a4c2b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.881291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66278db-672b-48bb-9c21-5fcfe43a4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.899198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b66278db-672b-48bb-9c21-5fcfe43a4c2b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:06.900444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b66278db-672b-48bb-9c21-5fcfe43a4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:06.961259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 499/1028] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:06 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:06.966759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec72f-c998-44f5-977d-ccf07da6991b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.967055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec72f-c998-44f5-977d-ccf07da6991b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.967358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec72f-c998-44f5-977d-ccf07da6991b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.969229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 530/1029] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:19:06.974278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:06.974572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:06.974853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:06.985546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ec72f-c998-44f5-977d-ccf07da6991b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:06.992650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:06.993835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:06.997851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ec72f-c998-44f5-977d-ccf07da6991b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.003341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 500/1030] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:06 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:07.003485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.003485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.003485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.003734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] PATH_INFO: `/v3/services/image` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.004313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.005895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.017649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:19:07.018951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 531/1031] 10.222.0.65 () {56 vars in 1126 bytes} [Mon Feb 21 09:19:06 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:07.024801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.026139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.035115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b0da-d21c-4e3d-8ea4-32b64dc2e7b3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.036247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90d68-d54d-4e66-85c0-d2ff1a74836e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.039748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.040417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.040705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.040814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.041016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.041564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.041724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.041871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.042016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.042211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.043713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.053545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:07.053705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 501/1032] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:07.054849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.060762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:19:07.061956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 532/1033] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:07.065751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf175f-3485-4064-99ec-91831d726273 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.067812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.070433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.071084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.071393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.071677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.072383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.072847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.074817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.078072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c775-09b2-4bf7-9d7c-32b6ee663894 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.079883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 502/1034] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:07.082896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.083586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.083869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.084144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.084916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.085217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.085731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.086919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.095047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ebce1-5873-480c-8bb6-4955889dec21 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.095762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 533/1035] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:07.099654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.100385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.100673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.100951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.101127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.101691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.103440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.111582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b37c-35c0-4610-8dec-143633fff717 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.116322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.117105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.117385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.117660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.137051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.137051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.147651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:07.148856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 534/1036] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:07.154490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.163957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23523a74-0751-4d53-bdff-d9b752252a36 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.169293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.169980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.170268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.170547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.171382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.171723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.173436 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.186907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 535/1037] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:07.192242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.202037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3f1f-e9bb-4b5a-aeea-32c68162fdbd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.206778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.207642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.207942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.208193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.216817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.218879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.226344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 503/1038] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:19:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:19:07.235093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:19:07.236682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 536/1039] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:07.243041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.265671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a678e-2905-41ca-91be-3f9e7f52a919 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.271166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.275446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.275446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.275446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.275446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.275446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.275878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.301829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 504/1040] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:07.302951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.313635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a9a6-1e2f-46c8-a81b-e93ae8984cb8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.318533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.319214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.319534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.319817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.328783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.330652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.342151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 537/1041] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:07.348671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.359522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49753d6-d534-4e51-b5d1-25301dd55c3b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.364341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.365153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.365485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.365761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.381091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.381091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.400347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:07.401767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 505/1042] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:07.407990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.417378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adc711-c86a-4341-bda9-ee6f4e268376 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.422861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.423617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.423899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.424222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.424939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.425248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.426828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.440373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 538/1043] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:07.446039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.456736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39a493-dafe-4246-bc54-239df31e2ab2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.463541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.464415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.465320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.465524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.473169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.475386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.490300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:19:07.491555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 506/1044] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:07.497818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.508572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beffbd-bf3d-4570-ae10-7be4ab765e9e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.513442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.514241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.514623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.515001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.515930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.516609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.518554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01585fab-c9d5-4f92-bb95-1cdf0b90896f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.532207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 539/1045] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:07.537952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:07.549402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2264-7d0e-4634-98e4-c5d25a68e5c3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:07.554303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:07.554940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:07.555230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:07.555540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:07.556371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] RBAC: Adding query filter params (role.id=aac8be11260a4593b3bdb47cbda7c67c, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:07.556687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:07.558642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c01889-e8d6-4257-a200-cf521aaeb669 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:07.564618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 507/1046] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:07 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=aac8be11260a4593b3bdb47cbda7c67c => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:08.873481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ef52-f304-4de6-968d-e1140922fa97 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:08.874060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ef52-f304-4de6-968d-e1140922fa97 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:08.874060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293ef52-f304-4de6-968d-e1140922fa97 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:08.876002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 540/1047] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:08.881164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:08.881588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:08.881760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:08.900014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:08.901225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:08.909325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 508/1048] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:08.935290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293ef52-f304-4de6-968d-e1140922fa97 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:08.948199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293ef52-f304-4de6-968d-e1140922fa97 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:08.953391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:08.954195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:08.954482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:08.954758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:08.955972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:08.957686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183353af-c02f-4a51-9f77-c2541827afdb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:08.959541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 541/1049] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:08.965198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:08.974600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694e259-3955-4488-a318-632b9f36ec34 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:08.979238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:08.979961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:08.980283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:08.980563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:08.981301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:08.983259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8fa5f-c799-4f5e-949e-e50006df0592 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:09.123276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 509/1050] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:19:08 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:09.615511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22788-8b98-415e-8c4b-6f60add8c07b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.615868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22788-8b98-415e-8c4b-6f60add8c07b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.616069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f22788-8b98-415e-8c4b-6f60add8c07b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.617870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 542/1051] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:09.623357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.623656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.623935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.642187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:09.643703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:09.651494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 510/1052] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:09.674430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f22788-8b98-415e-8c4b-6f60add8c07b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:09.686623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f22788-8b98-415e-8c4b-6f60add8c07b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:09.690962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:09.691646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.691929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.692203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.700464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:09.702208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4653f8-da03-433b-89dd-9ded4571684c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:09.711846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 543/1053] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:09.717932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:09.726830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2663d1-68ca-43b6-a886-b6a459d6e95b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:09.731849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:09.732627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.732907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.733170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.734335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:09.736070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636012c-5ab3-4dd9-8d57-61f32ddf7926 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:09.737808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 511/1054] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:09.867594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9b78-b94c-44da-b46d-69247dbe5728 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.867955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9b78-b94c-44da-b46d-69247dbe5728 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.868146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c9b78-b94c-44da-b46d-69247dbe5728 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.870170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 544/1055] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:09.875777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.876070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.876346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.896721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:09.897956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:09.906717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 512/1056] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:09.929663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9b78-b94c-44da-b46d-69247dbe5728 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:09.943442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c9b78-b94c-44da-b46d-69247dbe5728 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:09.948211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:09.949579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.949867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.950154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.961830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:09.969993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:19:09.971465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 545/1057] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:19:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:09.977452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:09.986792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8a6e-fd13-45c1-91c6-0b571dc8e8b0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:09.991440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:09.992119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:09.992400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:09.992673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:09.993432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:09.993735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:09.995373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.004851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 513/1058] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:19:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:10.010558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.022530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3d29-5a6b-4a00-b8ad-47b6c30fd553 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.027450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.028262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.028547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.028823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.040456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.042472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.060536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:10.061953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 546/1059] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:10.067546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.078166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f49106-531e-4f5e-94a6-6a313ccfbd31 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.082780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.083478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.083767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.084044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.084768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:10.085076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.086675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.099377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 514/1060] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:10.104911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.114701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987769f6-9384-4084-b693-f9577a971b64 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.119254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.120032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.120339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.120601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.128066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.130082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.144533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:19:10.145865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 547/1061] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:10.151533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.162415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfe5ef-8ce0-46cf-847a-16ebb149b1e7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.167329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.168059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.168345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.168623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.169462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:10.169771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.171658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.190200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 515/1062] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:10.195815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.207174 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03700003-aba6-44b2-9712-f9c9bf53a473 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.211875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.212676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.212959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.213233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.224357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.226255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.244081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:10.245335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 548/1063] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:10.251634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.261327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8355-3c53-4f07-b3f2-fee7a78bbe0b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.266576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.267233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.267553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.267826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.268535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:10.268836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.270418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.281530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 516/1064] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:10.287188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.296921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc2cf7-de25-4a39-9d5f-1cd7ea5955ee admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.301391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.302172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.302454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.302729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.310098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.312082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.325755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:19:10.327060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 549/1065] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:10.333092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.343119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4fc6-c59e-4c39-828d-3a374328d540 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.347710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.348366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.348654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.348932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.349719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:10.350032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.351960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb8a8-1ccb-461f-969a-7420463cc310 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.366658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 517/1066] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:10.373262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:10.384776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4bef5-87d0-4ce4-a0e5-852e455520d2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:10.389876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:10.390740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:10.391019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:10.391551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/aac8be11260a4593b3bdb47cbda7c67c` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:10.393758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=e7eb5c189bbd41449e3478b7dfcb27fb, role_id=aac8be11260a4593b3bdb47cbda7c67c)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:10.396424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e14ba5-1d87-4608-b27d-bdec69c84376 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:10.448577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 550/1067] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:19:10 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/e7eb5c189bbd41449e3478b7dfcb27fb/roles/aac8be11260a4593b3bdb47cbda7c67c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:19:11.498240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507b024-b281-4408-9718-d4fc762282a0 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.498853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507b024-b281-4408-9718-d4fc762282a0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.498853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507b024-b281-4408-9718-d4fc762282a0 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.500685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 518/1068] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:19:11.507789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.508303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.508471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.526651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:11.527878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:11.589349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 551/1069] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:11.614725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507b024-b281-4408-9718-d4fc762282a0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.627759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507b024-b281-4408-9718-d4fc762282a0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.632125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.632910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.633193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.633467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.644098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:11.650952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:11.652178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 519/1070] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:11.658225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.667462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7b05c-a45b-4ecc-bc8e-224f20f32414 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.672527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.673200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.673485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.673760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.674511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:11.674818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:11.676444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:11.686097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 552/1071] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:11.691752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.702052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa50ca-aeea-4523-bb30-e95f85df997a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.706615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.707489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.707781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.708063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] PATH_INFO: `/v3/users/ff85ec5d62d04fbba162ee556090cfe1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.722385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] RBAC: Authorizing `identity:get_user(user_id=ff85ec5d62d04fbba162ee556090cfe1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:11.724590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:11.726316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 520/1072] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/users/ff85ec5d62d04fbba162ee556090cfe1 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:11.733805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.743670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c226c-65ee-4888-8a97-06ee690a2b3f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.748238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.748929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.749158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.749428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.757396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:11.759123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:11.768009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 553/1073] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:11.773901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.784254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b6792-515b-48aa-9944-81901b2ffbae admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.788902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.789757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.790036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.790304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.791519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:11.794188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bc136-6ef2-493c-ad24-7e7d6945c1e8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:11.795940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 521/1074] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:11.802055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:11.811091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdffd8-d04e-467a-900d-49d1bff96648 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:11.815713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:11.816364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:11.816645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:11.816916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:11.817736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=1f858c9c300347298556e5e487a379a4, user.id=ff85ec5d62d04fbba162ee556090cfe1) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:11.818045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:11.819907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20794c9-5289-4ae0-a5a5-f5685f16b8ac admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:11.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 554/1075] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:11 2022] GET /identity/v3/role_assignments?user.id=ff85ec5d62d04fbba162ee556090cfe1&scope.project.id=1f858c9c300347298556e5e487a379a4&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:12.785591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870dfa-540f-4874-a8a1-73dca7a50bb8 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:12.786126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870dfa-540f-4874-a8a1-73dca7a50bb8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:12.786213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870dfa-540f-4874-a8a1-73dca7a50bb8 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:12.788021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 522/1076] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:12.794313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:12.794824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:12.795022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:12.813232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:12.814447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:12.822595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 555/1077] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:12.847862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870dfa-540f-4874-a8a1-73dca7a50bb8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:12.860327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870dfa-540f-4874-a8a1-73dca7a50bb8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:12.865060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:12.865880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:12.866164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:12.866441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:12.882589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:12.890582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:19:12.892147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 523/1078] 10.222.0.65 () {56 vars in 1141 bytes} [Mon Feb 21 09:19:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:12.898196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:12.908070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a8929-64d5-4856-b481-daeb1d7f2ef7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:12.914219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:12.915265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:12.915594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:12.915847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:12.916689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:12.917225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:12.918866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:12.932574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 556/1079] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:19:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:12.933943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:12.946740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283322f-7b0a-45e0-9f4e-8df5415d4bd8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:12.953050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:12.953876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:12.954166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:12.954442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:12.966631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:12.969188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:12.992137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:12.993397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 524/1080] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:13.001351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.014154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37950fd-1efb-43f1-8e80-a869369e89d4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.019126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.019830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.020121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.020519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.021843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:13.022399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.024656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.039142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 557/1081] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:13.045337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.055527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923eef7-f474-4495-82ea-89fd4bc343d9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.060259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.061140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.061470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.061808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.069841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.072996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.089045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:19:13.090881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 525/1082] 10.222.0.65 () {56 vars in 1114 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:13.096627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.108676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c71b-b733-4fef-a95c-33b5a7d74c0c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.113142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.113807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.114092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.114366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.115198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:13.115541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.117371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.137307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 558/1083] 10.222.0.65 () {56 vars in 1154 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:13.143520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.159013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186014-4c71-4bef-8c3a-b293305c04a1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.163709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.164347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.164633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.164907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.177369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.179165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.189979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 526/1084] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:13.198046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.205288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fba24a-c737-4689-8fd9-bdbba4d5277b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.209872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.210648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.210926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.211279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.221729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.223573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.244531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:19:13.246455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 559/1085] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:13.252157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.262255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1267-658d-4cf3-a1fb-123022754573 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.267154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.267963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.268497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.268983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.270259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:13.270803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.273092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.286159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 527/1086] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:13.292108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.302221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b613-dde8-414b-ab9d-a654a555c08d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.306922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.307740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.308027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.308828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.315773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.317697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.331526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:19:13.332721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 560/1087] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:13.338667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.350655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162192a5-bb2d-44e8-9d1c-d0232e6bec17 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.355783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.356448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.356733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.357008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.357791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:13.358098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.360030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc63d12-4747-49f5-8608-6c029da38f28 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.375799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 528/1088] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:13.384301 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:13.395824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85d0d6-c334-4130-a4ff-f65cd1b67276 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:13.404027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:13.404702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:13.404990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:13.405273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:13.406109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] RBAC: Adding query filter params (role.id=aac8be11260a4593b3bdb47cbda7c67c, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=e7eb5c189bbd41449e3478b7dfcb27fb) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:13.406424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:13.408300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb52d-9076-433f-af2e-96b0598374b2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:13.414546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 561/1089] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:13 2022] GET /identity/v3/role_assignments?user.id=e7eb5c189bbd41449e3478b7dfcb27fb&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=aac8be11260a4593b3bdb47cbda7c67c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:14.149909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2916-61f8-47af-b97d-44df54f21591 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.150424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2916-61f8-47af-b97d-44df54f21591 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.150518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2916-61f8-47af-b97d-44df54f21591 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.154370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 529/1090] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:14.158094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.158495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.158639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.176742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:14.177964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:14.185909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 562/1091] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:14.208809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2916-61f8-47af-b97d-44df54f21591 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:14.221842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2916-61f8-47af-b97d-44df54f21591 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:14.226304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:14.227086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.227422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.227701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.238482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:14.250520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:14.251902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 530/1092] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:14.258009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:14.267997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6cb3b-09d8-4114-a548-55f94cbeb397 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:14.272546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:14.273203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.273491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.273770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.274516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:14.274825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:14.276457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:14.284928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 563/1093] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:14.290795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:14.301422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84380f69-cb1d-4e8e-967f-9d263c2be47e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:14.305901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:14.306740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.307020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.307288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] PATH_INFO: `/v3/users/ff85ec5d62d04fbba162ee556090cfe1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.308980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] RBAC: Authorizing `identity:get_user(user_id=ff85ec5d62d04fbba162ee556090cfe1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:14.311183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:14.312782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 531/1094] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:14 2022] GET /identity/v3/users/ff85ec5d62d04fbba162ee556090cfe1 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:14.318474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:14.328685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92071f-f067-4d0e-a393-a9485ead31d0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:14.333152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:14.333982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.334268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.334543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.335744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:14.337766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f467-d093-494d-9f28-5c4d5e20f2d7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:14.339391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 564/1095] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:14 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:14.344774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:14.354045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad4259-1b51-457f-a122-ad4f9576bc7f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:14.359001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:14.359877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:14.360160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:14.360438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4/users/ff85ec5d62d04fbba162ee556090cfe1/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:14.362359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f858c9c300347298556e5e487a379a4, user_id=ff85ec5d62d04fbba162ee556090cfe1, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:14.364991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732f7e-cf28-4550-81e6-0b0cd61dd117 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:14.441634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 532/1096] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:19:14 2022] PUT /identity/v3/projects/1f858c9c300347298556e5e487a379a4/users/ff85ec5d62d04fbba162ee556090cfe1/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:19:16.689680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa53a9a-6976-4fef-a85c-e17ba15a6400 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.690193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa53a9a-6976-4fef-a85c-e17ba15a6400 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.690285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa53a9a-6976-4fef-a85c-e17ba15a6400 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.692026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 565/1097] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:16.697135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.697529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.697682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.716081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:16.717246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:16.771910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 533/1098] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:16.795695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa53a9a-6976-4fef-a85c-e17ba15a6400 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.807538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa53a9a-6976-4fef-a85c-e17ba15a6400 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.812430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.813195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.813480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.813757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.824129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:16.840181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:16.841366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 566/1099] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:16.849296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.858655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff70fc-efe3-458f-aa0e-4e5a78fdbfd6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.863138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.863821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.864109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.864385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.865124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:16.865429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:16.867034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:16.875622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 534/1100] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:16.880852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.890372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c926b-09aa-4f5c-9f09-a35f21183526 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.895108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.895976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.896265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.896543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] PATH_INFO: `/v3/users/ff85ec5d62d04fbba162ee556090cfe1` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.897734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff85ec5d62d04fbba162ee556090cfe1)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:16.899901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:16.901458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 567/1101] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/users/ff85ec5d62d04fbba162ee556090cfe1 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:16.906651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.915782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ca5e-4884-4a73-96ed-a891093236f8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.920748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.921351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.921635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.921910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.929320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:16.931006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:16.940128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 535/1102] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:16.945265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.955599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e12a-1b05-4dc9-a410-38ee8ac34d70 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.960187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.961025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.961311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.961589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.962759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:16.965345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8757efb-36f9-44c5-affb-1c5981835cc8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:16.966998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 568/1103] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:16.973002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:16.982244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58056d-9df3-4978-9200-2e22c86fe4b8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:16.986711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:16.987363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:16.987648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:16.987927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:16.988742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=1f858c9c300347298556e5e487a379a4, user.id=ff85ec5d62d04fbba162ee556090cfe1) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:16.989051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:16.990883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c60cf6-e3dd-43b7-b3d4-a1017cf5876f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:16.996384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 536/1104] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:16 2022] GET /identity/v3/role_assignments?user.id=ff85ec5d62d04fbba162ee556090cfe1&scope.project.id=1f858c9c300347298556e5e487a379a4&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:19.288558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66832da-87b4-49cb-bd9f-9c114bfc9603 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:19.289122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66832da-87b4-49cb-bd9f-9c114bfc9603 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:19.289122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66832da-87b4-49cb-bd9f-9c114bfc9603 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:19.290858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 569/1105] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:19.296779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:19.297201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:19.297351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:19.316453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:19.318196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:19.329419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 537/1106] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:19.354308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66832da-87b4-49cb-bd9f-9c114bfc9603 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:19.366963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66832da-87b4-49cb-bd9f-9c114bfc9603 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:19.371267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:19.372060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:19.372343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:19.372616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:19.373761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:19.375441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d10048-b561-4a04-bd67-13505f8ef420 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:19.376972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 570/1107] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:19.382263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:19.390886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9d8d0-6dee-48f6-b2b7-99e602644239 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:19.395733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:19.396377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:19.396660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:19.396930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:19.397622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:19.399511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af3ce1-d8fb-451b-aad2-1c0ac0494485 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:19.493329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 538/1108] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:19:19 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:21.818150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff97b4-fde3-4abd-9fa9-030c16dfdb99 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.818705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff97b4-fde3-4abd-9fa9-030c16dfdb99 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.818705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff97b4-fde3-4abd-9fa9-030c16dfdb99 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.820517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 571/1109] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:21.826089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.826564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.826674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.843892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:21.845059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:21.852601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 539/1110] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:21.877785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff97b4-fde3-4abd-9fa9-030c16dfdb99 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:21.889896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff97b4-fde3-4abd-9fa9-030c16dfdb99 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:21.894529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:21.895395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.895700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.895983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] PATH_INFO: `/v3/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.897438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] RBAC: Authorizing `identity:get_role(role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:21.898440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:19:21.898440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:19:21.898440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:19:21.899320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:21.900616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 572/1111] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:21 2022] GET /identity/v3/roles/25dd5c2d68ea41728022051659ca3b76 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:21.905790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:21.914455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d5229-f6d9-4139-bb8e-2f14eecb2a70 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:21.919456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:21.920291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.920573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.920847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] PATH_INFO: `/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.934147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e405b54883c4bdda5d3cc8a41ce73ed)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:21.936314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:21.937878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 540/1112] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:21 2022] GET /identity/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:21.943053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:21.952316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8f6d4-bed4-40ff-8853-10aa10af6b4b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:21.956786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:21.957391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.957674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.957947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.966017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:21.967744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:21.976266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 573/1113] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:21.982168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:21.991290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eabe8e-82db-42c1-bac2-938b56e97984 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:21.996271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:21.997079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:21.997360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:21.997631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:21.998776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:22.000791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8988c2-aa59-4cc1-ad7b-ec4179728441 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:22.002377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 541/1114] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:21 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:22.007739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:22.016037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a769e4c-9d11-4eb5-976f-f979fd54e1a0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:22.020842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:22.021444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:22.021729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:22.022005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:22.022806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=1f858c9c300347298556e5e487a379a4, user.id=6e405b54883c4bdda5d3cc8a41ce73ed) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:22.023114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:22.024904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22a7a-e0cf-483c-8ce9-d6d9b6355bc6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:22.030139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 574/1115] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:22 2022] GET /identity/v3/role_assignments?user.id=6e405b54883c4bdda5d3cc8a41ce73ed&scope.project.id=1f858c9c300347298556e5e487a379a4&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:24.244499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fafd-30b9-44a2-ace7-51aecbc74861 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.245027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fafd-30b9-44a2-ace7-51aecbc74861 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.245027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45fafd-30b9-44a2-ace7-51aecbc74861 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.246863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 542/1116] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:24.251983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.252408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.252549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.270804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:24.272015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:24.280256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 575/1117] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:24.303222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45fafd-30b9-44a2-ace7-51aecbc74861 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:24.314911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45fafd-30b9-44a2-ace7-51aecbc74861 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:24.319185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:24.320025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.320306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.320577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] PATH_INFO: `/v3/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.322010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] RBAC: Authorizing `identity:get_role(role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:24.323013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:19:24.323013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:19:24.323013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:19:24.324464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:24.325739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 543/1118] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:24 2022] GET /identity/v3/roles/25dd5c2d68ea41728022051659ca3b76 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:24.330994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:24.340185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735c08-9c81-4bb6-8695-9370c7f35035 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:24.344892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:24.345759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.346048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.346325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] PATH_INFO: `/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.347547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=6e405b54883c4bdda5d3cc8a41ce73ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:24.349643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:24.351331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 576/1119] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:24 2022] GET /identity/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:24.356440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:24.365532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f60770-ff10-4b31-a55d-6d7a21fa1a8b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:24.369963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:24.370758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.371042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.371356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.372506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:24.374480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149e057-90a1-4221-81b6-27aa2fd7a627 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:24.376232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 544/1120] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:24 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:24.381386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:24.390980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf255cc0-ee14-43b2-84ad-1bc366ed94d9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:24.395730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:24.396549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:24.396833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:24.397109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4/users/6e405b54883c4bdda5d3cc8a41ce73ed/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:24.399267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f858c9c300347298556e5e487a379a4, user_id=6e405b54883c4bdda5d3cc8a41ce73ed, role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:24.402420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a2a65-7b21-4ef4-865f-9180bcd60b8a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:24.469973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 577/1121] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:19:24 2022] PUT /identity/v3/projects/1f858c9c300347298556e5e487a379a4/users/6e405b54883c4bdda5d3cc8a41ce73ed/roles/25dd5c2d68ea41728022051659ca3b76 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:19:26.739169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cc829-aa3b-4cb3-9ca9-f280239b284d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.739720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cc829-aa3b-4cb3-9ca9-f280239b284d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.739833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cc829-aa3b-4cb3-9ca9-f280239b284d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.742229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 545/1122] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:26.748068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.748457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.748628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.766412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:26.767866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:26.822748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 578/1123] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:26.847051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cc829-aa3b-4cb3-9ca9-f280239b284d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:26.859036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cc829-aa3b-4cb3-9ca9-f280239b284d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:26.863396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:26.864227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.864515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.864792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] PATH_INFO: `/v3/roles/25dd5c2d68ea41728022051659ca3b76` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.866247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] RBAC: Authorizing `identity:get_role(role_id=25dd5c2d68ea41728022051659ca3b76)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:26.867877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:26.869187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 546/1124] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:26 2022] GET /identity/v3/roles/25dd5c2d68ea41728022051659ca3b76 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:26.874990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:26.883749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da25f-3f6c-433c-b49a-e235b7d9e847 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:26.888805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:26.889649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.889937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.890215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] PATH_INFO: `/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.891439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] RBAC: Authorizing `identity:get_user(user_id=6e405b54883c4bdda5d3cc8a41ce73ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:26.893817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:26.895405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 579/1125] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:26 2022] GET /identity/v3/users/6e405b54883c4bdda5d3cc8a41ce73ed => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:26.900496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:26.909681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4e29-dee1-4812-99e9-06c9bd49fb23 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:26.914101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:26.914694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.914976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.915250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.922708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:26.924429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:26.933476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 547/1126] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:26.938651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:26.947788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cfbf0-ac6c-4c6d-96ee-b680a405578e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:26.952867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:26.953648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.953931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.954206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] PATH_INFO: `/v3/projects/1f858c9c300347298556e5e487a379a4` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.955421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f858c9c300347298556e5e487a379a4)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:26.957398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660fbd9-8a3d-4891-bf63-97b6a605c050 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:26.959129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 580/1127] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:26 2022] GET /identity/v3/projects/1f858c9c300347298556e5e487a379a4 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:26.964524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:26.980328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccf566-0e0d-4a8d-ac7a-29e76c346bc2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:26.984959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:26.985587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:26.985870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:26.986140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:26.986955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] RBAC: Adding query filter params (role.id=25dd5c2d68ea41728022051659ca3b76, scope.project.id=1f858c9c300347298556e5e487a379a4, user.id=6e405b54883c4bdda5d3cc8a41ce73ed) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:26.987265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:26.989106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7b0cc-7fb5-4e41-b461-9e12e8bbc2aa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:26.994710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 548/1128] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:26 2022] GET /identity/v3/role_assignments?user.id=6e405b54883c4bdda5d3cc8a41ce73ed&scope.project.id=1f858c9c300347298556e5e487a379a4&role.id=25dd5c2d68ea41728022051659ca3b76 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:29.296450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527f92b-be05-4a8b-aedd-6e6ea45b976b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:29.296977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527f92b-be05-4a8b-aedd-6e6ea45b976b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:29.297088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527f92b-be05-4a8b-aedd-6e6ea45b976b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:29.298774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 581/1129] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:29.303995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:29.304410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:29.304557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:29.322360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:29.323570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:29.331143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 549/1130] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:29.355923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527f92b-be05-4a8b-aedd-6e6ea45b976b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:29.375960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527f92b-be05-4a8b-aedd-6e6ea45b976b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:29.380383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:29.381152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:29.381437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:29.381712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:29.382877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:29.384582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa36d-d1eb-4416-b828-2bb3cbe2df05 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:29.386154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 582/1131] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:29.392156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:29.401062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b356-df1b-489d-a6dd-44b230fe5c43 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:29.406115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:29.406761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:29.407041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:29.407337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:29.408039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:29.409938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b790416-94c9-4e46-93cc-5a066cddb08d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:29.500043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 550/1132] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:19:29 2022] POST /identity/v3/projects => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:31.772514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cbf0-8bfe-4bc5-8b83-517532444721 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:31.773023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cbf0-8bfe-4bc5-8b83-517532444721 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:31.773113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cbf0-8bfe-4bc5-8b83-517532444721 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:31.774845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 583/1133] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:31.780576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:31.780994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:31.781142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:31.799172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:31.800387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:31.854382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 551/1134] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:31.879552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578cbf0-8bfe-4bc5-8b83-517532444721 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:31.893078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578cbf0-8bfe-4bc5-8b83-517532444721 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:31.897498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:31.898264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:31.898552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:31.898833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:31.900035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:31.902227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944e0ab-03be-4751-840b-d39c2e7a3063 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:31.903900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 584/1135] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:19:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:31.909346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:31.918825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73602fd3-2834-44a7-af48-dfa0a330dc58 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:31.923345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:31.923997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:31.924279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:31.924551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:31.925250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:31.927164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b911d7-0c7d-42c7-8624-502523751dc4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:32.007044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 552/1136] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:19:31 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:34.364020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99525f9-0264-4762-a5a9-3bcdcb5ce6c5 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.364567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99525f9-0264-4762-a5a9-3bcdcb5ce6c5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.364567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99525f9-0264-4762-a5a9-3bcdcb5ce6c5 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.366393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 585/1137] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:34.372206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.372623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.372762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.390159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:34.391382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:34.399133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 553/1138] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:34.423066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99525f9-0264-4762-a5a9-3bcdcb5ce6c5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.435779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99525f9-0264-4762-a5a9-3bcdcb5ce6c5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.440207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.440975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.441263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.441542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.451586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:34.458421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:34.459586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 586/1139] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:34.465254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.473957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9541301-5adb-41e5-992c-bc3abadadfbf None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.478404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.479045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.479359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.479638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.480926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:34.481232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:34.482819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:34.490722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 554/1140] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:34.496545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.506408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224224d-ee9e-427e-9d95-d24b36c70e8d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.510946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.511815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.512103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.512379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] PATH_INFO: `/v3/users/65529c858c75482ea7a4828103e412b8` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.525443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] RBAC: Authorizing `identity:get_user(user_id=65529c858c75482ea7a4828103e412b8)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:34.527600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:34.529208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 587/1141] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/users/65529c858c75482ea7a4828103e412b8 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:34.534688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.544598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908b86-bcc5-4aca-b79f-5f4f3926e9f3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.549042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.549661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.549943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.550219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.557676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:34.559999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:34.568557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 555/1142] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:34.573841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.583248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba0e8-4403-47c3-8d1f-fff9a9c7a367 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.587798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.588629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.588913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.589693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] PATH_INFO: `/v3/projects/9c3ad250fdb14efe82f3588a84f05b75` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.590853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] RBAC: Authorizing `identity:get_project(project_id=9c3ad250fdb14efe82f3588a84f05b75)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:34.592911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79176ff-541e-415b-a35e-92e38cb5d18e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:34.594522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 588/1143] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/projects/9c3ad250fdb14efe82f3588a84f05b75 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:34.600167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:34.609363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d173d4-6c3d-46ae-bef3-78d14044ba56 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:34.613935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:34.614632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:34.614847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:34.615125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:34.615986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=9c3ad250fdb14efe82f3588a84f05b75, user.id=65529c858c75482ea7a4828103e412b8) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:34.616303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:34.618122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d805fe-f98b-462a-8870-073daa62c6a4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:34.623343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 556/1144] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:34 2022] GET /identity/v3/role_assignments?user.id=65529c858c75482ea7a4828103e412b8&scope.project.id=9c3ad250fdb14efe82f3588a84f05b75&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:36.879854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fd04-47ab-4828-835b-a4fb0214dcfa None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:36.880395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fd04-47ab-4828-835b-a4fb0214dcfa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:36.880395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4fd04-47ab-4828-835b-a4fb0214dcfa None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:36.882160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 589/1145] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:36.887820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:36.888190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:36.888383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:36.905888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:36.907072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:36.914624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 557/1146] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:36.937395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4fd04-47ab-4828-835b-a4fb0214dcfa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:36.949820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4fd04-47ab-4828-835b-a4fb0214dcfa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:36.954105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:36.954854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:36.955134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:36.955448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:36.965276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:36.971943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:36.973056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 590/1147] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:36.978502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:36.987757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae59b-015a-4a14-93fd-d0a9ae2c0f1a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:36.992277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:36.992932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:36.993222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:36.993498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:36.994244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:36.994555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:36.996687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:37.004684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 558/1148] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:37.010140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:37.021932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91723139-9f06-47a9-a105-bcf3c0ef6001 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:37.026343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:37.027194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:37.027500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:37.027773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] PATH_INFO: `/v3/users/65529c858c75482ea7a4828103e412b8` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:37.028945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] RBAC: Authorizing `identity:get_user(user_id=65529c858c75482ea7a4828103e412b8)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:37.031036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:37.032597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 591/1149] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:37 2022] GET /identity/v3/users/65529c858c75482ea7a4828103e412b8 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:37.037857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:37.047157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c4494-4f64-4141-844f-6d674942ee61 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:37.051633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:37.052446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:37.052732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:37.053010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] PATH_INFO: `/v3/projects/9c3ad250fdb14efe82f3588a84f05b75` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:37.054170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] RBAC: Authorizing `identity:get_project(project_id=9c3ad250fdb14efe82f3588a84f05b75)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:37.056195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1942e05-ca56-417f-8c19-540cb3a61285 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:37.058293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 559/1150] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:37 2022] GET /identity/v3/projects/9c3ad250fdb14efe82f3588a84f05b75 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:37.063556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:37.072844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01353ed-c294-40e3-a550-3c0eb158b934 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:37.077933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:37.078789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:37.079075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:37.079384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] PATH_INFO: `/v3/projects/9c3ad250fdb14efe82f3588a84f05b75/users/65529c858c75482ea7a4828103e412b8/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:37.081345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ad250fdb14efe82f3588a84f05b75, user_id=65529c858c75482ea7a4828103e412b8, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:37.083987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803951-b761-487a-8083-06aa94012c1e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:37.179891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 592/1151] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:19:37 2022] PUT /identity/v3/projects/9c3ad250fdb14efe82f3588a84f05b75/users/65529c858c75482ea7a4828103e412b8/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:19:39.438417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bde9-fe6d-452a-bad0-5f7ec7188087 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.439049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bde9-fe6d-452a-bad0-5f7ec7188087 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.439049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bde9-fe6d-452a-bad0-5f7ec7188087 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.440766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 560/1152] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:39.445953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.446378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.446518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.464491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:39.465693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:39.521805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 593/1153] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:39.546275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669bde9-fe6d-452a-bad0-5f7ec7188087 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.559278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669bde9-fe6d-452a-bad0-5f7ec7188087 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.563756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.564523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.564811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.565091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.575144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:39.581909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:39.583077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 561/1154] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:39.589446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.599515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99756011-5bd3-44b4-8d86-40fa039d822a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.605426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.606098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.606405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.606686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.607583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:39.607921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:39.609824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:39.619546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 594/1155] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:39.625599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.635640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3462a14-d32a-4bb8-ac26-1ae9e464f925 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.640146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.640978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.641261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.641539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] PATH_INFO: `/v3/users/65529c858c75482ea7a4828103e412b8` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.643003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] RBAC: Authorizing `identity:get_user(user_id=65529c858c75482ea7a4828103e412b8)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:39.645155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:39.646727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 562/1156] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/users/65529c858c75482ea7a4828103e412b8 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:39.652372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.662144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d45d-8221-4d93-a755-382695855c26 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.666926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.668095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.668381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.668659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.677035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:39.678892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:39.688488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 595/1157] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:39.694160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.703909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede0de0-fcf5-457b-81db-80ce3a945c52 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.708442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.709269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.709552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.709829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] PATH_INFO: `/v3/projects/9c3ad250fdb14efe82f3588a84f05b75` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.710988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] RBAC: Authorizing `identity:get_project(project_id=9c3ad250fdb14efe82f3588a84f05b75)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:39.713056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e48744-0345-4637-9dc3-9e194e80d6ce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:39.714679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 563/1158] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/projects/9c3ad250fdb14efe82f3588a84f05b75 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:39.720364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:39.729051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8b457-d438-4725-ae22-ff33edb4308c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:39.734340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:39.734968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:39.735254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:39.735586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:39.736469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=9c3ad250fdb14efe82f3588a84f05b75, user.id=65529c858c75482ea7a4828103e412b8) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:39.736836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:39.739072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e4576-0a02-456c-b2e5-69d5163a87ec admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:39.745064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 596/1159] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:39 2022] GET /identity/v3/role_assignments?user.id=65529c858c75482ea7a4828103e412b8&scope.project.id=9c3ad250fdb14efe82f3588a84f05b75&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:42.009689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705aa60-13f3-4361-b9b5-fd110bfe4933 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:42.010238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705aa60-13f3-4361-b9b5-fd110bfe4933 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:42.010238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705aa60-13f3-4361-b9b5-fd110bfe4933 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:42.012065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 564/1160] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:42.017711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:42.018076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:42.018379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:42.035680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:42.036856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:42.044963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 597/1161] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:42.069330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705aa60-13f3-4361-b9b5-fd110bfe4933 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:42.081490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705aa60-13f3-4361-b9b5-fd110bfe4933 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:42.086067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:42.087748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:42.087748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:42.087748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:42.095575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:42.097439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:42.106561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 565/1162] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:42.111994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:42.120966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbff2a-946f-4d27-b9d2-41f052212327 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:42.125484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:42.126260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:42.126540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:42.126838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:42.133556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:42.135375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:42.149624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d6409cc0-9155-4649-aef7-c0af1096ecaa admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 21 09:19:42.150734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 598/1163] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:19:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:19:42.156840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:42.165441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32f795-af2a-4a3e-9fa4-f3ae6d73f3d6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:42.170604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:42.171281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:42.171593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:42.171899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:42.172620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:42.172921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:42.174502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4efe-c0b8-48e8-9135-a49a314a3836 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:42.181512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 566/1164] 10.222.0.65 () {56 vars in 1136 bytes} [Mon Feb 21 09:19:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:44.435713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465aade-4de4-404a-b607-2939884ae080 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:44.436234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465aade-4de4-404a-b607-2939884ae080 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:44.436326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465aade-4de4-404a-b607-2939884ae080 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:44.438023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 599/1165] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:44.443109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e95c0-ac7c-49c0-8d03-05fbdea14a58 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:44.443507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e95c0-ac7c-49c0-8d03-05fbdea14a58 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:44.443829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e95c0-ac7c-49c0-8d03-05fbdea14a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:44.461488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-635e95c0-ac7c-49c0-8d03-05fbdea14a58 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:44.462640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-635e95c0-ac7c-49c0-8d03-05fbdea14a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:44.470266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 567/1166] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:44.497128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465aade-4de4-404a-b607-2939884ae080 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:44.509183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465aade-4de4-404a-b607-2939884ae080 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:44.514199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:44.514835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:44.515113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:44.515420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:44.516159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:44.517414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:19:44.517414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:19:44.517414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:19:44.518279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325bde5-7bf7-40f4-a3e9-7cd505363957 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:44.580980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 600/1167] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Feb 21 09:19:44 2022] POST /identity/v3/domains => generated 267 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:46.855870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6310b7-ec2d-4f1a-91a0-0528a68a4e38 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:46.856377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6310b7-ec2d-4f1a-91a0-0528a68a4e38 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:46.856482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6310b7-ec2d-4f1a-91a0-0528a68a4e38 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:46.858207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 568/1168] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:46.863234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:46.863703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:46.863827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:46.881858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:46.883044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:46.938360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 601/1169] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:46.962063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6310b7-ec2d-4f1a-91a0-0528a68a4e38 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:46.973898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6310b7-ec2d-4f1a-91a0-0528a68a4e38 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:46.978189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:46.979022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:46.979322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:46.979610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] PATH_INFO: `/v3/domains/d378974562b740c2a1c7cc1b6b4323d1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:46.990281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d378974562b740c2a1c7cc1b6b4323d1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:46.992280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da9257-b39c-4597-bd1b-a7cd05cfed8c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:46.993837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 569/1170] 10.222.0.65 () {56 vars in 1204 bytes} [Mon Feb 21 09:19:46 2022] GET /identity/v3/domains/d378974562b740c2a1c7cc1b6b4323d1 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:46.999895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:47.008504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601bb9-a050-4e00-a340-1c9fc2f5ce02 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:47.012976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:47.013608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:47.013889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:47.014161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:47.014859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:47.016999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab898c-a304-444c-bf65-7acde7edf92c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:47.100075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 602/1171] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:19:46 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:49.405641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5a06-0483-48c5-b06d-7903db8e76ed None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:49.406170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5a06-0483-48c5-b06d-7903db8e76ed None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:49.406170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5a06-0483-48c5-b06d-7903db8e76ed None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:49.407999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 570/1172] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:49.413057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:49.413443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:49.413614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:49.431483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:49.432659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:49.487620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 603/1173] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:49.512701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5a06-0483-48c5-b06d-7903db8e76ed None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:49.524979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5a06-0483-48c5-b06d-7903db8e76ed None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:49.529947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:49.530776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:49.531061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:49.531369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] PATH_INFO: `/v3/domains/d378974562b740c2a1c7cc1b6b4323d1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:49.532556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=d378974562b740c2a1c7cc1b6b4323d1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:49.534507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e647f94-e747-4be0-aa0c-f245a3f51123 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:49.536091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 571/1174] 10.222.0.65 () {56 vars in 1204 bytes} [Mon Feb 21 09:19:49 2022] GET /identity/v3/domains/d378974562b740c2a1c7cc1b6b4323d1 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:49.541266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:49.550069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306aac-ce0a-4407-bf27-f4462c2d0eb7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:49.554506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:49.555153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:49.555477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:49.555753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:49.556451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:49.558381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca98cb-dd66-4d31-9723-f73e7746d3c1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:49.681896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 604/1175] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:19:49 2022] POST /identity/v3/users => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:19:52.010126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e89a1-3971-42b9-b813-4bb4e286c779 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.010674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e89a1-3971-42b9-b813-4bb4e286c779 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.010674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e89a1-3971-42b9-b813-4bb4e286c779 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.013232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 572/1176] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:52.018724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.019117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.019284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.036608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:52.037778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:52.045378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 605/1177] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:52.069590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e89a1-3971-42b9-b813-4bb4e286c779 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.082102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e89a1-3971-42b9-b813-4bb4e286c779 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.086467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.087227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.087547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.087826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.098163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:52.105053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:52.106188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 573/1178] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:52.111723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.120983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e84d-1fbd-4b1e-bc54-72720e734b80 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.125471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.126115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.126443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.126717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.127488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:52.127795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:52.129369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:52.138121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 606/1179] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:52.143621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.153014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d55c-af9e-4621-b3a8-846d4eec683f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.157567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.158381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.158673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.158951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] PATH_INFO: `/v3/users/96129fb548e044ed95384558448834c9` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.172175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] RBAC: Authorizing `identity:get_user(user_id=96129fb548e044ed95384558448834c9)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:52.174306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:52.175926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 574/1180] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/users/96129fb548e044ed95384558448834c9 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:52.183509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.192043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d94ae1-47fc-4b5e-82b4-5f20a04175d7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.196960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.197630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.197914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.198191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.206386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:52.208276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:52.217072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 607/1181] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:52.222981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.233197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ecc6d-6f62-4852-86a6-a5693074fd43 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.237819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.238656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.238942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.239219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] PATH_INFO: `/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.240449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] RBAC: Authorizing `identity:get_project(project_id=6010d15ec1ff41bc9022b2d94e9d0801)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:52.242517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26602cf-ee4c-4a0a-9b08-1f5d56568f51 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:52.244176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 575/1182] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:52.251131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:52.267759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725974d-3989-4c6c-8fee-1daa461e6839 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:52.268666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:52.269448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:52.269733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:52.270008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:52.270867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=6010d15ec1ff41bc9022b2d94e9d0801, user.id=96129fb548e044ed95384558448834c9) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:52.271181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:52.273484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82ed4-b9cf-4226-92d8-e88a95155fb6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:52.279263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 608/1183] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:52 2022] GET /identity/v3/role_assignments?user.id=96129fb548e044ed95384558448834c9&scope.project.id=6010d15ec1ff41bc9022b2d94e9d0801&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:54.520283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d75f-d0ff-4a3f-bfed-eb5760551d5c None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.520830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d75f-d0ff-4a3f-bfed-eb5760551d5c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.520830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3d75f-d0ff-4a3f-bfed-eb5760551d5c None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.522607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 576/1184] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:54.528369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.528745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.528926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.546205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:54.547411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:54.554928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 609/1185] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:19:54.577694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3d75f-d0ff-4a3f-bfed-eb5760551d5c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:54.590165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3d75f-d0ff-4a3f-bfed-eb5760551d5c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:54.594531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:54.595315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.595611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.595891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.605834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:54.612631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:54.613765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 577/1186] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:54.619451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:54.628270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18cbad-ca56-4d24-aa6e-aa6acbb8e6a3 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:54.632756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:54.633402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.633686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.633963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.634701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:54.635008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:54.637178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:54.645463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 610/1187] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:54.650728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:54.661960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ffa0-54d4-46df-9854-7007f0b2fdbe admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:54.666461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:54.667278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.667590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.667865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] PATH_INFO: `/v3/users/96129fb548e044ed95384558448834c9` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.669033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] RBAC: Authorizing `identity:get_user(user_id=96129fb548e044ed95384558448834c9)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:54.671127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:54.672711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 578/1188] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:54 2022] GET /identity/v3/users/96129fb548e044ed95384558448834c9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:54.677742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:54.686816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530822-9f62-4158-b53e-523770b217bd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:54.691248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:54.692089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.692374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.692650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] PATH_INFO: `/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.693797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] RBAC: Authorizing `identity:get_project(project_id=6010d15ec1ff41bc9022b2d94e9d0801)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:54.695823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1db8e-7acf-4688-9f64-f2f31f76fdbd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:54.697410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 611/1189] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:54 2022] GET /identity/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:54.703023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:54.712106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89071a-fd97-4d8b-9817-196452fd3e19 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:54.717106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:54.717927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:54.718212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:54.718492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] PATH_INFO: `/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801/users/96129fb548e044ed95384558448834c9/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:54.720442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6010d15ec1ff41bc9022b2d94e9d0801, user_id=96129fb548e044ed95384558448834c9, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:54.722998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4105b-c944-46ce-b435-cfce95a0ad53 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:54.784009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 579/1190] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:19:54 2022] PUT /identity/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801/users/96129fb548e044ed95384558448834c9/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:19:57.019852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0645e5-a177-4df6-a1df-dada38aaf386 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.020406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0645e5-a177-4df6-a1df-dada38aaf386 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.020406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0645e5-a177-4df6-a1df-dada38aaf386 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.022190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 612/1191] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:19:57.027806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.028221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.028362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.045521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:19:57.046715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:19:57.100469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 580/1192] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:19:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:19:57.124085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0645e5-a177-4df6-a1df-dada38aaf386 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.136475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0645e5-a177-4df6-a1df-dada38aaf386 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.140844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.141608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.142188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.142469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.152428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:19:57.159178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:19:57.160329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 613/1193] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:19:57.165774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.174442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d06ea5-2da5-480f-a46e-19cff8fba9c0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.178862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.179539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.179826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.180102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.180839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:57.181145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:57.183257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:57.191152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 581/1194] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:19:57.196422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.207062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45888d1-e217-4f07-8ff2-087ab8a51931 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.211601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.212416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.212701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.212974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] PATH_INFO: `/v3/users/96129fb548e044ed95384558448834c9` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.214150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] RBAC: Authorizing `identity:get_user(user_id=96129fb548e044ed95384558448834c9)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:57.216296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:57.217991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 614/1195] 10.222.0.65 () {56 vars in 1198 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/users/96129fb548e044ed95384558448834c9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:57.222924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.231923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717253cb-0792-43f7-9b33-2b365237bb37 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.236354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.236952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.237236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.237511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.244982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:57.247210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:57.255773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 582/1196] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:19:57.261483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.271165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9c05-6f12-47f1-a5d2-70689968051e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.275630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.276437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.276701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.276977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] PATH_INFO: `/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.278129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] RBAC: Authorizing `identity:get_project(project_id=6010d15ec1ff41bc9022b2d94e9d0801)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:57.280154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096cb3-104a-429d-b925-136ee28e5833 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:57.281861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 615/1197] 10.222.0.65 () {56 vars in 1207 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/projects/6010d15ec1ff41bc9022b2d94e9d0801 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:19:57.287057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:19:57.296323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20790abb-a56d-462c-b5d8-d6b973ff33e8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:19:57.300796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:19:57.301412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:19:57.301695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:19:57.301970 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:19:57.302780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=6010d15ec1ff41bc9022b2d94e9d0801, user.id=96129fb548e044ed95384558448834c9) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:19:57.303088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:19:57.304922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28169c9d-4670-46f4-b3b3-05af9c2ad5c2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:19:57.311039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 583/1198] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:19:57 2022] GET /identity/v3/role_assignments?user.id=96129fb548e044ed95384558448834c9&scope.project.id=6010d15ec1ff41bc9022b2d94e9d0801&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:14.976231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961c2f-b283-464e-8745-c30856cb6726 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:14.976813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961c2f-b283-464e-8745-c30856cb6726 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:14.976813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961c2f-b283-464e-8745-c30856cb6726 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:14.979066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 616/1199] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:14.984272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:14.984674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:14.984831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:15.002928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:15.004140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:15.012744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 584/1200] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:21:15.037641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961c2f-b283-464e-8745-c30856cb6726 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:15.050119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961c2f-b283-464e-8745-c30856cb6726 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:15.054434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:15.057434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:15.057434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:15.057434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:15.066291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:15.068176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:15.085242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:15.086437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 617/1201] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:15.092740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:15.101768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad817c4d-424b-4d99-9e73-3135cb12b4ae None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:15.107074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:15.107747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:15.108032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:15.108307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:15.109029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:15.109337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:15.111025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a19dac-4d05-421c-b5ee-dee141157213 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:15.122309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 585/1202] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:15.127975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:15.137469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5940667-0569-4787-a364-8d25ea9b79c1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:15.142147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:15.146259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:15.146259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:15.146259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:15.146259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:15.146259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4db50c-fe84-4665-b816-73a04d86ac51 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:15.218574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 618/1203] 10.222.0.65 () {60 vars in 1153 bytes} [Mon Feb 21 09:21:15 2022] POST /identity/v3/users => generated 251 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:21:17.610402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd541-8a6f-420d-8d69-2b335a035946 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.610905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd541-8a6f-420d-8d69-2b335a035946 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.610996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd541-8a6f-420d-8d69-2b335a035946 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.612782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 586/1204] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:17.618014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.618437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.618631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.636417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:17.637589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:17.645475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 619/1205] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:21:17.675592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd541-8a6f-420d-8d69-2b335a035946 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.688829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd541-8a6f-420d-8d69-2b335a035946 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.693329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.694099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.694382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.694965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.706618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:17.714353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:21:17.715535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 587/1206] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:17.721571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.730524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f85bf8-9a15-4352-b6b4-40e16ed78cc2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.735200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.735891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.736176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.736449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.737185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:17.737491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.739069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.747026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 620/1207] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:17.752531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.762651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825db6b0-3edf-401d-a857-bec7c76cc7f7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.768363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.768363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.768775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.769051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.779766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.781575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.797906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:17.799042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 588/1208] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:17.804724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.814957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00413a99-657a-4071-8988-075ab8673d09 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.819618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.820262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:17.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.825787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.835386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 621/1209] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:17.841196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.850582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744c9f-2dfd-4eab-b31c-87b98071f5f6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.855072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.855904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.856348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.856623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.863722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.865900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.879463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:17.880573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 589/1210] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:17.886704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.896686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625b6b-043e-4617-b281-3c27689b719c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.901953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.902608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.902889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.903168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.904037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:17.904350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.906198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.923041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 622/1211] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:17.928638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.938167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e786-758a-4fcf-bc5a-00ae02f93305 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.942776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.943439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.943724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.943998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.952040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.953839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:17.963433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 590/1212] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:21:17.968948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:17.978375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dd226-befe-4a68-a9ff-a3b56d2e407e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:17.982905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:17.983704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:17.983993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:17.984270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:17.994392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:17.996253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:18.013201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:18.014358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 623/1213] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:18.020110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:18.029756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899ce3-7c63-4ea4-b51f-bf4d23f0103f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:18.034245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:18.036437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:18.036437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:18.036437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:18.036437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:18.036774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:18.038056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:18.049612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 591/1214] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:18.055468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:18.069523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b1f0-f36c-4433-8bb3-d555cc45bc6a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:18.074870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:18.078143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:18.078425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:18.078700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:18.085916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:18.088463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:18.101173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:18.102326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 624/1215] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:18.108311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:18.118138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f642-c731-4d77-9f9f-99d055d6a5f9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:18.123316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:18.123968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:18.124256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:18.124534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:18.125319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:18.125635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:18.127494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a07da8-2f8b-4feb-98c9-90aea703e425 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:18.139840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 592/1216] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:18.145902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:18.156438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d509f4-6f5a-44c2-b177-5959e7c6b6cc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:18.161011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:18.162674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:18.162674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:18.162674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:18.163018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=50283131637940ae9445c1800a8abb7d) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:18.163285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:18.165141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a287-d2cc-4b19-ae48-83219dd2e6ca admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:18.170421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 625/1217] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:21:18 2022] GET /identity/v3/role_assignments?user.id=50283131637940ae9445c1800a8abb7d&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:20.445308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800452d-73d1-486e-9e76-85822d820a53 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.445892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800452d-73d1-486e-9e76-85822d820a53 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.445892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800452d-73d1-486e-9e76-85822d820a53 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.447871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 593/1218] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:20.453116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.453517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.455849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.471408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:20.472644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:20.484924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 626/1219] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:21:20.507991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800452d-73d1-486e-9e76-85822d820a53 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.520291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800452d-73d1-486e-9e76-85822d820a53 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.524641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.526027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.526306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.526577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.536562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:20.543968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:21:20.545112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 594/1220] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:20.550979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.559874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a96bf6-1a24-47dc-b9cc-ad813f7fcfad None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.564383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.565030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.565311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.565581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.566314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:20.566616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.568265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.576833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 627/1221] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:20.582518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.593134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717225ca-b36e-403c-bb66-0c6a2572487f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.597678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.598442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.598729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.599273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.609520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.611383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.627555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:20.628673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 595/1222] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:20.634210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.644202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fad1-249d-4214-b1f4-33da0e9e1d77 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.648724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.649366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.649649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.650434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.651140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:20.651492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.653073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.664940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 628/1223] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:20.670988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.680739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e155a-a0eb-41ba-89cd-3454f50dae42 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.685524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.686300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.686581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.686851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.694306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.697494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.711475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:20.713267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 596/1224] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:20.718974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.728644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f78c3-ade3-4354-a74c-594563e573c1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.733249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.733895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.734177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.734460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.735279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:20.735618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.737522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.754791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 629/1225] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:20.761221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.771238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866686f9-8adc-4d3c-94ed-2df0f542bf55 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.776358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.777122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.777403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.782986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.787739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.789600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.805933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:20.807097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 597/1226] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:20.812681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.822997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec43f93-743a-4d93-9901-a4cb1ad25108 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.827688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.828332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.828616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.828893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.829612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:20.829920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.831542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.843276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 630/1227] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:20.848655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.858127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0330ee-d5ab-44cd-8d26-bbb3eccb3dcf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.862677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.863478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.863768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.864043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.870822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.872864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.886653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:20.887900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 598/1228] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:20.894053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.904403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84e8dc-17fc-43b6-bcb2-2dd8da7f9eff admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.909095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.909735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.910019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.910297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.911074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:20.911415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.913250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c7aa-a6d3-4f69-9fee-be939cad47a6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:20.925588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 631/1229] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:20.931870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:20.943110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7008-d1c9-44d2-9c31-6071ca86be71 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:20.951862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:20.951862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:20.951862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:20.951862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/50283131637940ae9445c1800a8abb7d/roles/4670f4bd5e2f48a8b03e0a6100e9e41f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:20.962933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=50283131637940ae9445c1800a8abb7d, role_id=4670f4bd5e2f48a8b03e0a6100e9e41f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:20.965592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72dea8-f112-4e52-ab2d-a1e9bd67343f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:21.050236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 599/1230] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:21:20 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/50283131637940ae9445c1800a8abb7d/roles/4670f4bd5e2f48a8b03e0a6100e9e41f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:21:23.329175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328b8-0e8c-4123-b920-fe64e3c852b0 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.329710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328b8-0e8c-4123-b920-fe64e3c852b0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.329821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c328b8-0e8c-4123-b920-fe64e3c852b0 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.331595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 632/1231] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:23.336652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.337095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.337784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.355487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:23.356680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:23.413515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 600/1232] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:23.437443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c328b8-0e8c-4123-b920-fe64e3c852b0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.450141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c328b8-0e8c-4123-b920-fe64e3c852b0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.455769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.456566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.456826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.457100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.469044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:23.475984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:21:23.477229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 633/1233] 10.222.0.65 () {56 vars in 1123 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:23.483102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.491835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0312a-d51c-4a04-bb85-c0123a222208 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.496931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.497574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.497855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.498128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.498858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.499162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.500872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.508959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 601/1234] 10.222.0.65 () {56 vars in 1124 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:23.515180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.525662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e957b-4c0b-4b9a-8168-4d7c9c435e1c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.530222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.530983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.534618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.534618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.541652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.543502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.560200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:23.561332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 634/1235] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:23.569964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.577418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4feabb-a951-46a7-a32d-bbd69a40ad16 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.582020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.582609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.582894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.583173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.583938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.584249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.585902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.597386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 602/1236] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:23.602999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.612787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dc4b8-1407-4fee-8a5d-678c63eb08bc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.617483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.618257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.619169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.619720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.627621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.629625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.644336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:23.645465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 635/1237] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:23.651231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.660765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68b15-ba0a-495a-b40a-a442d9357e0e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.665295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.665946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.666758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.666758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.667323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.667659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.670399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.687679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 603/1238] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:23.693592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.703279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d9cd-bc4b-4198-8852-d18e61a0509d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.708086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.708719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.709010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.709288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.717151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.718903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.727727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 636/1239] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:21:23.733858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.744243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94f389-8a76-4d95-91be-434cc99d6d5d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.748786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.749561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.749840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.751502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.760940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.764393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.785447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:23.786601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 604/1240] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:23.793010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.801979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88416ce6-1875-4a47-a43c-4be46d649a9d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.807389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.808035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.808319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.808592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.809299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.809603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.811245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.822713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 637/1241] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:23.828351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.838003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fc25-07d1-4540-bbc2-258c46d48db1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.842808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.843605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.843891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.844162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.850904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.853484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.866194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:23.867469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 605/1242] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:23.873615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.883258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed0b4-a43f-4f2f-a94d-d7adde4d2741 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.887853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.888481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.888762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.889035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.889803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.890107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.892067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86daa33-fe29-4ee9-9548-4a6c147d19e2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.905328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 638/1243] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:23.911132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:23.921823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6cef-6dbf-4386-b7a4-1d1cc9c30590 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:23.926390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:23.927009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:23.927312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:23.927598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:23.928415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] RBAC: Adding query filter params (role.id=4670f4bd5e2f48a8b03e0a6100e9e41f, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=50283131637940ae9445c1800a8abb7d) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:23.928728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:23.930546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bdf7a-cea8-4095-a513-9b6ab04cb8ed admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:23.936569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 606/1244] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:21:23 2022] GET /identity/v3/role_assignments?user.id=50283131637940ae9445c1800a8abb7d&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=4670f4bd5e2f48a8b03e0a6100e9e41f => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:26.271390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0090-0a23-4abe-8d4f-a715a424c50f None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.271944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0090-0a23-4abe-8d4f-a715a424c50f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.271944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a0090-0a23-4abe-8d4f-a715a424c50f None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.273707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 639/1245] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:26.279920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.280505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.280505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.298120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:26.299325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:26.307042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 607/1246] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:26.330801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a0090-0a23-4abe-8d4f-a715a424c50f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.343393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a0090-0a23-4abe-8d4f-a715a424c50f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.347792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.348542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.348821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.349088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.359340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:26.366071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:21:26.367207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 640/1247] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:26.373506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.382337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13675b8b-1166-461e-80d4-4a01560f65e9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.387403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.388051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.388336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.388615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.389362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.389669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.391257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.399801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 608/1248] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:26.405255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.414760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee420b-5d2d-46b6-9ba3-059a37611fa1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.419409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.420166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.420453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.420735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.431910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.433760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.450646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:26.451820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 641/1249] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:26.458991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.469755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b613-2d23-4580-b546-ab0a99a07457 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.474275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.474922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.475200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.475501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.476211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.476516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.478131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.489686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 609/1250] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:26.496052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.505492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34b3f-8081-47cb-82ae-00141563eaa8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.510706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.511524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.511806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.512076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.520214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.527355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.535245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:26.536383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 642/1251] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:26.542190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.551800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb18abc-e1f4-42ab-a50b-daaafddb289c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.556815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.557476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.557755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.558035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.558862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.559172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.561042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.578389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 610/1252] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:26.584231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.593792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27a8d-cd5b-40ea-bc2c-e5fc1aa1bb86 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.598240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.598860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.599140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.599475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.607278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.609030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.619044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 643/1253] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:21:26.624848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.634726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5d26-c061-4b48-ad12-6d25e9c79197 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.639552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.657407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.657407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.657407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.657407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.657407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.670503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:26.671725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 611/1254] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:26.677869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.686812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da7640-e949-472d-ae92-d81ab9cb9061 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.691341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.691984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.692262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.692533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.693233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.693534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.695089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.707274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 644/1255] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:26.713172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.722960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6945d-e4f5-4bd3-88f6-57fb9224fe10 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.727497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.728296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.728583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.728859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.735563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.737582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.750578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:26.751739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 612/1256] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:26.757371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.767624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e85806-6b4a-4456-9107-d35f3cb67e19 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.772412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.773069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.773500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.773781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.774549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.775460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.777272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25c01-27c5-4aad-91d9-158a5f71e24d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.794100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 645/1257] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:26.794737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:26.805629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f9e96-abbc-4139-ad7d-ce9b25d72514 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:26.810145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:26.810762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:26.811044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:26.811336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:26.812147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=50283131637940ae9445c1800a8abb7d) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:26.812453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:26.814274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98943d-e684-4968-87f9-c02cbee722d5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:26.819407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 613/1258] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:21:26 2022] GET /identity/v3/role_assignments?user.id=50283131637940ae9445c1800a8abb7d&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.065475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033159-24e0-48e5-b93a-0ced89597660 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.066064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033159-24e0-48e5-b93a-0ced89597660 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.066064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033159-24e0-48e5-b93a-0ced89597660 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.067968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 646/1259] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:29.073896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.074304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.074458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.092068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:29.093257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:29.100971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 614/1260] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:21:29.123933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033159-24e0-48e5-b93a-0ced89597660 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.136709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033159-24e0-48e5-b93a-0ced89597660 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.141183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.141946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.142259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.142531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.153459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:29.160268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:21:29.161412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 647/1261] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:29.167116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.175851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b053f-1e95-4442-9550-6d13cbe189a4 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.181013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.181013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.181299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.181583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.182312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:29.182614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.184227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.192111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 615/1262] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.198021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.208267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f33b3f-49e0-4e01-b1d2-548aa04397b6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.213376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.214127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.214414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.214693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.224781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.226745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.242838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:29.243980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 648/1263] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:29.249436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.259427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752d58c-e1cf-41c3-90f1-e458dce120d0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.263882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.264510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.264790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.265060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.265767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:29.266068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.267690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.280102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 616/1264] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.285310 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.294882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e827cf0-b9d4-4071-b055-24071dd85d8e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.299477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.300230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.300515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.300785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.308085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.310065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.324315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:29.325344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 649/1265] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:29.330806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.340348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acbb5c-a49a-417a-b206-86a9b370c408 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.345157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.345811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.346099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.346374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.347194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:29.347541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.349376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.367181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 617/1266] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.373220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.386650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf791b-26f3-4910-9a96-2dcac415faf6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.391847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.392074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.392345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.392619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.402848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.404755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.421275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:29.423103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 650/1267] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:29.428186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.438182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a139d82-1c2b-4d52-acb7-72af36d2a57e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.442875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.443544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.443835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.444111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.444821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:29.445167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.447273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.458347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 618/1268] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.463771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.473286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505299-9f24-4b65-b227-3bea0a349ca7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.477932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.478687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.478971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.479247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.486219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.488232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.501602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:29.502801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 651/1269] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:29.508468 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.519047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afddb7a-feb5-4a38-ac92-f8d481a474dd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.523611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.524563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.524853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.525196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.526092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:29.526405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.528295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2488f5-3326-43e8-b25b-1115927a4951 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.661268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 619/1270] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:29.667339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:29.677752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450edfe-d325-4165-bd0d-0364b122878c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:29.683027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:29.683990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:29.684276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:29.684555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] PATH_INFO: `/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/50283131637940ae9445c1800a8abb7d/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:29.686789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0871a61b4c9c4295b0e5aab04fcb5619, user_id=50283131637940ae9445c1800a8abb7d, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:29.689485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579493d-b2b8-4ce0-acd7-10dab0ac9536 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:29.787647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 652/1271] 10.222.0.65 () {58 vars in 1460 bytes} [Mon Feb 21 09:21:29 2022] PUT /identity/v3/projects/0871a61b4c9c4295b0e5aab04fcb5619/users/50283131637940ae9445c1800a8abb7d/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:21:32.073974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17b0a-9397-467c-83dc-d009a15cc567 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.074501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17b0a-9397-467c-83dc-d009a15cc567 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.074501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d17b0a-9397-467c-83dc-d009a15cc567 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.076304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 620/1272] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:32.081562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.081956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.082130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.100058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:32.101260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:32.158918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 653/1273] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:32.182897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d17b0a-9397-467c-83dc-d009a15cc567 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.195423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d17b0a-9397-467c-83dc-d009a15cc567 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.200508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.210374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.210374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.210374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.212001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:21:32.219449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:21:32.220686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 621/1274] 10.222.0.65 () {56 vars in 1117 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:32.226438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.235444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe0df2-070f-48aa-8a93-10d17992a8f7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.240170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.240825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.241110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.241388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.242135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.242444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.244124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.252496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 654/1275] 10.222.0.65 () {56 vars in 1120 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:32.257972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.269090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae307-3456-4004-898c-5ce7dce844fb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.273808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.275193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.275571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.275846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.286114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.287979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.304319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:32.305452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 622/1276] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:32.311222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.320861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065dc59-3b22-4a65-b5b7-760c12020371 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.325999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.326580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.326868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.327146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.327895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.328205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.329804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.342075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 655/1277] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:32.347690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.357209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2a0b9-a678-48b3-a7c1-dd755b79d739 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.361640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.362400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.362680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.362953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.370571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.376692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.386077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 09:21:32.387174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 623/1278] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:32.392603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.403091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f67ac2-8c50-423c-8cf2-c5146fde8483 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.407669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.411405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.411405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.411405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.411405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.411405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.411880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.431338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 656/1279] 10.222.0.65 () {56 vars in 1164 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:32.434941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.444809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dd813-178b-4aa3-98dd-dc089cc19872 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.450033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.450667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.450955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.451234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.458912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.460818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.469674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 624/1280] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:21:32.475262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.484848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba1499-c548-4a89-a139-300c6c329046 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.489521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.490292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.490580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.490858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.501653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.503833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.531263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:21:32.532498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 657/1281] 10.222.0.65 () {56 vars in 1129 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:21:32.538255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.547104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84d02-07f7-4180-baa9-e15999c64741 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.551958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.552604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.552895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.553167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.553885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.554193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.556321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.568025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 625/1282] 10.222.0.65 () {56 vars in 1130 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:32.573857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.583819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7ca42-90b1-4dc1-9d76-287a7dd1b1d7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.588410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.589179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.589463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.589738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.596489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.598429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.611179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING keystone.server.flask.application [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:21:32.612329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 658/1283] 10.222.0.65 () {56 vars in 1132 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:32.618044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.627925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac44ec2-d751-4283-93bd-77fdece31891 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.632438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.633076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.633366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.633643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.635037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.635375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.637201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c61c2d-d354-4881-a333-5aecba837918 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.648559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 626/1284] 10.222.0.65 () {56 vars in 1169 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:32.654231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:32.664463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da80a-c778-46f5-9d4d-e915bbcf0937 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:32.669179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:32.669809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:32.670095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:32.670374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:32.671183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] RBAC: Adding query filter params (role.id=df7e26fc5ae142e6b88e95bef3637384, scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619, user.id=50283131637940ae9445c1800a8abb7d) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:32.671537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:32.673351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffeba6-5ed8-40bc-9476-0df46286447c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:32.679170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 659/1285] 10.222.0.65 () {56 vars in 1395 bytes} [Mon Feb 21 09:21:32 2022] GET /identity/v3/role_assignments?user.id=50283131637940ae9445c1800a8abb7d&scope.project.id=0871a61b4c9c4295b0e5aab04fcb5619&role.id=df7e26fc5ae142e6b88e95bef3637384 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:34.974508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e404-4a07-4fef-9936-e93167f8de29 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:34.975028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e404-4a07-4fef-9936-e93167f8de29 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:34.975140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e404-4a07-4fef-9936-e93167f8de29 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:34.976936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 627/1286] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:34.982550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:34.982920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:34.983095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:35.000596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:35.001761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:35.009464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 660/1287] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:35.031793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e404-4a07-4fef-9936-e93167f8de29 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:35.044438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e404-4a07-4fef-9936-e93167f8de29 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:35.048853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:35.049621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:35.049908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:35.050186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:35.050856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:35.052466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:35.063786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 09:21:35.064895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 628/1288] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:21:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:35.070539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:35.079447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521aacc-fcbb-4c62-85da-3ede37124f6e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:35.084085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:35.084733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:35.085057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:35.085335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:35.086037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:35.086344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:35.087992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4f64c-4977-4662-93f9-f5809818aba5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:35.092792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 661/1289] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Feb 21 09:21:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:35.098042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:35.108398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29330263-1b02-4dc1-ab81-ea7a778306a3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:35.112908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:35.113536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:35.113819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:35.114094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] PATH_INFO: `/v3/services` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:35.114794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:35.115144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:35.116717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f37b6-f8cd-4af8-8602-863a04426ace admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:35.121665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 629/1290] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Feb 21 09:21:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:21:37.438326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c99d8-3755-4074-9bd1-9fbbd3460e35 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:37.438326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c99d8-3755-4074-9bd1-9fbbd3460e35 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:37.438326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c99d8-3755-4074-9bd1-9fbbd3460e35 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:37.438326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 662/1291] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:37.444022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa6400-cf4a-49d5-bd85-dc1762c354b6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:37.444421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa6400-cf4a-49d5-bd85-dc1762c354b6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:37.444577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa6400-cf4a-49d5-bd85-dc1762c354b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:37.461802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6eaa6400-cf4a-49d5-bd85-dc1762c354b6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:37.463081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6eaa6400-cf4a-49d5-bd85-dc1762c354b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:37.470891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 630/1292] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:37.494709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c99d8-3755-4074-9bd1-9fbbd3460e35 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:37.506838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c99d8-3755-4074-9bd1-9fbbd3460e35 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:37.511312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:37.511986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:37.512292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:37.512571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:37.513299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:37.514878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ef11a-d6c6-4c72-acfa-969799eaae3d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:37.642032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 663/1293] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Feb 21 09:21:37 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:21:40.026047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bca7-e366-4ce0-87fb-48d9cb4fd6e7 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.026590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bca7-e366-4ce0-87fb-48d9cb4fd6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.026590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05bca7-e366-4ce0-87fb-48d9cb4fd6e7 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.028445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 631/1294] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:40.033628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.034992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.034992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.052171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:40.058149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:40.069601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 664/1295] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:40.093327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bca7-e366-4ce0-87fb-48d9cb4fd6e7 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:40.105976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05bca7-e366-4ce0-87fb-48d9cb4fd6e7 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:40.110400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:40.111167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.111484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.111765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.112418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:40.114003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:40.124856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 09:21:40.125974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 632/1296] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:21:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:40.131689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:40.140545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306df3-3f35-4180-b6a2-b1bddd6469a5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:40.145355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:40.145997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.146280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.146553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.147247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:40.147584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:40.149157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:40.154786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 665/1297] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Feb 21 09:21:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:40.160660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:40.170753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716489a-927b-45f0-b088-068c7e21d9a7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:40.175285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:40.175943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.176232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.176518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.177303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] RBAC: Adding query filter params (interface=public, service_id=3c3e38ba891b4e039318feae52bfe939, region_id=RegionOne) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:40.177619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:40.179196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f71ce-52ed-4f22-a222-80f814b10bce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:40.184061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 633/1298] 10.222.0.65 () {56 vars in 1272 bytes} [Mon Feb 21 09:21:40 2022] GET /identity/v3/endpoints?service_id=3c3e38ba891b4e039318feae52bfe939&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:40.189056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:40.199070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e754462-35ff-4763-9a32-876cbb6d8883 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:40.203623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:40.204263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:40.204549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:40.204826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:40.205499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:40.207056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eb1ee-7e45-46c9-b53a-c22627136a84 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:40.214311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 666/1299] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:21:40 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:21:42.468357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc7c79-1eab-4f7a-8ae1-0996b684cfa6 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:42.469038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc7c79-1eab-4f7a-8ae1-0996b684cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:42.469038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc7c79-1eab-4f7a-8ae1-0996b684cfa6 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:42.470708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 634/1300] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:21:42.476790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:42.477858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:42.478028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:42.497597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:21:42.498856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:21:42.507078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 667/1301] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:21:42.531212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc7c79-1eab-4f7a-8ae1-0996b684cfa6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:42.544573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc7c79-1eab-4f7a-8ae1-0996b684cfa6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:42.549242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:42.550079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:42.550366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:42.550645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:42.551361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:42.553008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:42.565390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING keystone.server.flask.application [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 09:21:42.566625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 635/1302] 10.222.0.65 () {56 vars in 1138 bytes} [Mon Feb 21 09:21:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:21:42.574480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:42.582462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b02ce-982a-4cc8-b255-c31be6b96e80 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:42.587264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:42.587993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:42.588281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:42.588561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] PATH_INFO: `/v3/services` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:42.589286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:21:42.589664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:42.591337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e5421-27c5-441e-a2a9-24958c7f4fe6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:42.597241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 668/1303] 10.222.0.65 () {56 vars in 1137 bytes} [Mon Feb 21 09:21:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:21:42.603917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:21:42.614600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ec46-fca6-42ac-8f7f-01b435d1df6a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:21:42.620177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:21:42.620850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:21:42.621139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:21:42.621421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:21:42.622186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:21:42.623829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907570-c3f1-41b7-ab3d-169a79447a66 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:21:42.704872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 636/1304] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Feb 21 09:21:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:28:03.878848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:03.880431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:03.880919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:03.892876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbee42-44a6-457f-996b-960f50263477 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:03.893780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbee42-44a6-457f-996b-960f50263477 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:03.894285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbee42-44a6-457f-996b-960f50263477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:03.900411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 669/1305] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:03 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:04.014463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-54fbee42-44a6-457f-996b-960f50263477 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:04.015867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-54fbee42-44a6-457f-996b-960f50263477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:04.132345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 637/1306] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:04.167935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:04.169995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:04.324539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8edae-24f3-4fcd-9884-e95a72b7b815 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:04.419359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:04.419946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:04.420232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:04.420509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:04.421237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:04.423101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2cdb9-eee1-4a46-a035-d4f9db09e320 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:04.452422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 670/1307] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:28:04 2022] GET /identity/v3/projects => generated 2553 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:28:06.839700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00acc-d5b6-447f-98d7-505ad8e49e54 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:06.840635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00acc-d5b6-447f-98d7-505ad8e49e54 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:06.841060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00acc-d5b6-447f-98d7-505ad8e49e54 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:06.843053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 638/1308] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:06.848518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7008b-7e1d-4385-af3b-4c898c9da3ed None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:06.848924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7008b-7e1d-4385-af3b-4c898c9da3ed None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:06.849284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7008b-7e1d-4385-af3b-4c898c9da3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:06.934636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3db7008b-7e1d-4385-af3b-4c898c9da3ed None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:06.935895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3db7008b-7e1d-4385-af3b-4c898c9da3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:07.032760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 671/1309] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:07.087746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:07.088381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:07.088917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:07.090855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 639/1310] 10.222.0.65 () {54 vars in 964 bytes} [Mon Feb 21 09:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:07.098967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692223-3039-4717-a706-a5806a71287c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:07.099703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692223-3039-4717-a706-a5806a71287c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:07.100063 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00692223-3039-4717-a706-a5806a71287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:07.181844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-00692223-3039-4717-a706-a5806a71287c None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:07.183314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-00692223-3039-4717-a706-a5806a71287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:07.278486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 672/1311] 10.222.0.65 () {58 vars in 1061 bytes} [Mon Feb 21 09:28:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:07.292637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:07.294169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:07.398932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f79d5-86b9-4e87-8485-76e7fcd56432 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:07.471237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:07.471943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:07.472284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:07.473129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:07.474761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:07.584630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:07.586066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61326d-a696-4dbb-826d-c1bedf4ed1b0 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:07.604202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 640/1312] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:10.185252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:10.185749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:10.185749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:10.187525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 673/1313] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:10.192636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626e71-192d-443e-a6e4-5438c7ad4e6b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:10.193063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626e71-192d-443e-a6e4-5438c7ad4e6b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:10.193201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626e71-192d-443e-a6e4-5438c7ad4e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:10.256488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8b626e71-192d-443e-a6e4-5438c7ad4e6b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:10.257690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8b626e71-192d-443e-a6e4-5438c7ad4e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:10.350345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 641/1314] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:28:10.388085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:10.389629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:10.488437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3fa06-4693-4293-abc5-49e44cde3351 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:10.558912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:10.559581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:10.559865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:10.560140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:10.561758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:10.665993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:10.667459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468bf0b-68f5-4203-a059-6eea62f50d10 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:10.685113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 674/1315] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:13.488369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:13.488907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:13.488907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:13.490740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 642/1316] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:13.495843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5a5-1a63-414d-a876-67bc4a2f6c13 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:13.496236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5a5-1a63-414d-a876-67bc4a2f6c13 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:13.496407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e5a5-1a63-414d-a876-67bc4a2f6c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:13.559223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-91c1e5a5-1a63-414d-a876-67bc4a2f6c13 None None] MFA Rules not processed for user `c1751cf86da943269cce86604e4cfe9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:13.560459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-91c1e5a5-1a63-414d-a876-67bc4a2f6c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:13.653968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 675/1317] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:13.694589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:13.696090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:13.795391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acced57d-b9e4-41f7-8be0-b59932931262 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:13.864783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:13.865369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:13.865658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:13.865938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:13.867609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:13.980366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:13.981812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313eaa6b-2dc2-4e42-b7f7-d22bbb9a3dc9 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:13.999488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 643/1318] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:17.088467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ab3d-2391-4179-bf5f-20556d21133a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:17.089023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ab3d-2391-4179-bf5f-20556d21133a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:17.089119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661ab3d-2391-4179-bf5f-20556d21133a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:17.090837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 676/1319] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:17.096093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0607eb-c40e-4441-b456-b243b6fc394b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:17.096498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0607eb-c40e-4441-b456-b243b6fc394b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:17.096652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0607eb-c40e-4441-b456-b243b6fc394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:17.158905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2c0607eb-c40e-4441-b456-b243b6fc394b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:17.160128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2c0607eb-c40e-4441-b456-b243b6fc394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:17.261278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 644/1320] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:17.318663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:17.318953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:17.319234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:17.321048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 677/1321] 10.222.0.65 () {54 vars in 964 bytes} [Mon Feb 21 09:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:17.326847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bef5b-bad0-4eef-8c47-6cf4baa962a4 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:17.327140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bef5b-bad0-4eef-8c47-6cf4baa962a4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:17.327449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bef5b-bad0-4eef-8c47-6cf4baa962a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:17.399431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a24bef5b-bad0-4eef-8c47-6cf4baa962a4 None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:17.400532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a24bef5b-bad0-4eef-8c47-6cf4baa962a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:17.471764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 645/1322] 10.222.0.65 () {58 vars in 1061 bytes} [Mon Feb 21 09:28:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:17.480562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:17.482098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:17.584365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb992d-6558-4c26-824a-843fde9e3f27 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:17.653098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:17.653098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:17.653377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:17.653609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:17.655252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:17.762352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:17.763913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3ead6-01ed-43fc-8be2-d3c3daa203d6 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:17.782184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 678/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:21.481642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:21.482177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:21.482177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:21.483998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 646/1324] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:21.489300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a158c-7e4a-458e-b43f-dea06da5692e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:21.489712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a158c-7e4a-458e-b43f-dea06da5692e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:21.489855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a158c-7e4a-458e-b43f-dea06da5692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:21.553355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-530a158c-7e4a-458e-b43f-dea06da5692e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:21.554562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-530a158c-7e4a-458e-b43f-dea06da5692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:21.653594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 679/1325] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:21.691092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:21.693113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:21.792497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7196-c0d2-4295-9c2c-16c0ae3f6e19 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:21.861205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:21.861844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:21.862123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:21.862390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:21.864917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:21.969163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:21.970603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a25f25-4cd9-4007-9e8e-cd53fc7a3261 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:21.989087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 647/1326] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:24.467088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:24.467752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:24.467752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:24.469454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 680/1327] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:24.474979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f090e1-0732-41ea-8914-ed98d2bb7c54 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:24.475412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f090e1-0732-41ea-8914-ed98d2bb7c54 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:24.475661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f090e1-0732-41ea-8914-ed98d2bb7c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:24.552397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-51f090e1-0732-41ea-8914-ed98d2bb7c54 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:24.553634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-51f090e1-0732-41ea-8914-ed98d2bb7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:24.651881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 648/1328] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:24.686890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:24.688461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:24.790431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd474f-bff9-4e6f-bad0-07f5b9dd5ae2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:24.862552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:24.863230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:24.863548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:24.863852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:24.865469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:24.971371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:24.973404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33560d2-e037-484f-9741-a7ac977124c1 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:24.990689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 681/1329] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:27.406146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:27.406685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:27.406835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:27.408757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 649/1330] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:27.414674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86abb-460e-43e1-8416-506fc3f82e3e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:27.415087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86abb-460e-43e1-8416-506fc3f82e3e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:27.415417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86abb-460e-43e1-8416-506fc3f82e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:27.491902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b4d86abb-460e-43e1-8416-506fc3f82e3e None None] MFA Rules not processed for user `c1751cf86da943269cce86604e4cfe9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:27.493126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b4d86abb-460e-43e1-8416-506fc3f82e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:27.587185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 682/1331] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:27.624008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:27.625509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:27.726159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387bcce-605d-4f66-8493-5857a3f9ef3d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:27.796676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:27.797350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:27.797632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:27.797909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:27.799541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:27.902563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:27.904053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74aca-ec18-4953-973c-1876ff2afe5b service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:27.921274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 650/1332] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:30.632995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:30.633525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:30.633525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:30.635323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 683/1333] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:30.640805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad18-d350-4e21-a676-05cd77d7435a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:30.641281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad18-d350-4e21-a676-05cd77d7435a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:30.641281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16ad18-d350-4e21-a676-05cd77d7435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:30.710467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-dd16ad18-d350-4e21-a676-05cd77d7435a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:30.711780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-dd16ad18-d350-4e21-a676-05cd77d7435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:30.815474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 651/1334] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:30.846431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:30.848134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:30.952856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca2c42-bfa8-4308-934e-03c7097daaea None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:31.023251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:31.023940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:31.024227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:31.024506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:31.026158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:31.131668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:31.133037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93156b89-6ccd-4aec-9d39-37e6a4a8829e service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:31.151046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 684/1335] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:33.491660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:33.492262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:33.492262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:33.493996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 652/1336] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:33.499104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d6f8-d8db-4fa9-8957-b7ba319fc132 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:33.499519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d6f8-d8db-4fa9-8957-b7ba319fc132 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:33.499695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1d6f8-d8db-4fa9-8957-b7ba319fc132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:33.564842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2cb1d6f8-d8db-4fa9-8957-b7ba319fc132 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:33.566580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2cb1d6f8-d8db-4fa9-8957-b7ba319fc132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:33.660935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 685/1337] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:33.700344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:33.701866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:33.801193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab914c61-cb30-46c8-be6f-8f984cb2250d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:33.870503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:33.871152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:33.871705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:33.871814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:33.873410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:33.984433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:33.985881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e73ad-bd9b-4f44-bea1-35692842b94d service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:34.004253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 653/1338] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:36.865607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:36.866163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:36.866259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:36.868090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 686/1339] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:36.873560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d868-2727-493e-9bca-23d8355c001d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:36.874001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d868-2727-493e-9bca-23d8355c001d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:36.874126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481d868-2727-493e-9bca-23d8355c001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:36.939540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e481d868-2727-493e-9bca-23d8355c001d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:36.941361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e481d868-2727-493e-9bca-23d8355c001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:37.041404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 654/1340] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:28:37.077987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:37.080112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:37.177910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1f01-9e9d-405f-8b88-acb0caaf17a8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:37.177910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:37.178383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:37.178664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:37.178935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:37.188373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:37.190163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebe461-0013-4bf8-b8dc-bf8f355c6e5b service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:37.199972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 687/1341] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:41.691592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa487-9f16-471b-8369-4e43e58ec7ab None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:41.692105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa487-9f16-471b-8369-4e43e58ec7ab None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:41.692105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa487-9f16-471b-8369-4e43e58ec7ab None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:41.693833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 655/1342] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:41.699060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4923-f5d2-4c26-a33b-7708fe6f2c4d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:41.699509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4923-f5d2-4c26-a33b-7708fe6f2c4d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:41.699703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e4923-f5d2-4c26-a33b-7708fe6f2c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:41.729131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e23e4923-f5d2-4c26-a33b-7708fe6f2c4d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:41.730236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e23e4923-f5d2-4c26-a33b-7708fe6f2c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:41.804643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 688/1343] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:41.843083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affa487-9f16-471b-8369-4e43e58ec7ab None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:41.853958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affa487-9f16-471b-8369-4e43e58ec7ab None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:41.857458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:41.858095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:41.858381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:41.858660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:41.867856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:41.869285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86cde-7241-48db-9897-57aecb4a430b service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:41.883386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 656/1344] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:45.207658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb27e5-0e4d-4acb-a41d-7384280cfe32 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:45.208194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb27e5-0e4d-4acb-a41d-7384280cfe32 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:45.208194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb27e5-0e4d-4acb-a41d-7384280cfe32 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:45.209968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 689/1345] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:45.215117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56034a01-5ca1-4e0a-b6e7-832c721dfa12 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:45.215598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56034a01-5ca1-4e0a-b6e7-832c721dfa12 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:45.215729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56034a01-5ca1-4e0a-b6e7-832c721dfa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:45.233772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-56034a01-5ca1-4e0a-b6e7-832c721dfa12 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:45.234960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-56034a01-5ca1-4e0a-b6e7-832c721dfa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:45.243482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 657/1346] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:45.281071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb27e5-0e4d-4acb-a41d-7384280cfe32 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:45.291722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb27e5-0e4d-4acb-a41d-7384280cfe32 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:45.295260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:45.295986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:45.296334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:45.296671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:45.306247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:45.307849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4997787-5e89-487b-8fa1-913bc886ffa9 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:45.317907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 690/1347] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:49.934328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd3a42-4b0a-4784-8467-ba86ec5031cc None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:49.934896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd3a42-4b0a-4784-8467-ba86ec5031cc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:49.934896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd3a42-4b0a-4784-8467-ba86ec5031cc None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:49.936774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 658/1348] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:49.943695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b575f-da9d-48a2-b470-34caca1fd5ab None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:49.944251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b575f-da9d-48a2-b470-34caca1fd5ab None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:49.944251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b575f-da9d-48a2-b470-34caca1fd5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:49.966878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8a6b575f-da9d-48a2-b470-34caca1fd5ab None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:49.972168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8a6b575f-da9d-48a2-b470-34caca1fd5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:49.979379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 691/1349] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:50.014936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd3a42-4b0a-4784-8467-ba86ec5031cc None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:28:50.026926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd3a42-4b0a-4784-8467-ba86ec5031cc None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:28:50.030875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:28:50.031785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:50.032252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:50.032532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:50.043037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:28:50.044696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5fbdd-0c8b-4d80-8956-cc751e626fcd service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:28:50.056473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 659/1350] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:28:55.150928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87725-9755-42e0-a01b-8e6d6f4f2332 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:55.151768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87725-9755-42e0-a01b-8e6d6f4f2332 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:55.152219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f87725-9755-42e0-a01b-8e6d6f4f2332 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:55.155771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 692/1351] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:28:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:55.169624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990606b2-cc0a-4487-9f01-6d156cc36bf1 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:55.169624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990606b2-cc0a-4487-9f01-6d156cc36bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:55.169624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990606b2-cc0a-4487-9f01-6d156cc36bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:55.248383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-990606b2-cc0a-4487-9f01-6d156cc36bf1 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:55.249618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-990606b2-cc0a-4487-9f01-6d156cc36bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:55.335985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 660/1352] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:28:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:28:59.861960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f64b6-993a-45e3-adb5-51bb84d17a2b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:59.862480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f64b6-993a-45e3-adb5-51bb84d17a2b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:59.862480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f64b6-993a-45e3-adb5-51bb84d17a2b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:59.864255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 693/1353] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:28:59.869747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfde8-02d5-4228-a91b-f6ab1ec5e6d3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:28:59.870189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfde8-02d5-4228-a91b-f6ab1ec5e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:28:59.870308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bfde8-02d5-4228-a91b-f6ab1ec5e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:28:59.894259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d82bfde8-02d5-4228-a91b-f6ab1ec5e6d3 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:28:59.896067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d82bfde8-02d5-4228-a91b-f6ab1ec5e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:28:59.906928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 661/1354] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:01.356264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e170e-5a0c-4d6a-8dd6-bc3d9bdbc150 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:01.357210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e170e-5a0c-4d6a-8dd6-bc3d9bdbc150 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:01.357572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e170e-5a0c-4d6a-8dd6-bc3d9bdbc150 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:01.359399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 694/1355] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:01.448993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be322d-127f-4b8c-a830-c84d3835f1ab None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:01.449521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be322d-127f-4b8c-a830-c84d3835f1ab None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:01.449521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be322d-127f-4b8c-a830-c84d3835f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:01.468258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b8be322d-127f-4b8c-a830-c84d3835f1ab None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:01.469416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b8be322d-127f-4b8c-a830-c84d3835f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:01.478267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 662/1356] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:05.348709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39586ef-9903-4da2-b551-c9d42bca1831 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:05.349289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39586ef-9903-4da2-b551-c9d42bca1831 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:05.349289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39586ef-9903-4da2-b551-c9d42bca1831 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:05.356368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f45-5614-4023-9cc6-74eb4dde2018 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:05.357174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f45-5614-4023-9cc6-74eb4dde2018 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:05.357612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4f45-5614-4023-9cc6-74eb4dde2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:05.360382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 695/1357] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:05.381862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-976f4f45-5614-4023-9cc6-74eb4dde2018 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:05.383340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-976f4f45-5614-4023-9cc6-74eb4dde2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:05.407627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 663/1358] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:05.441319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5c2fb-50a1-4c82-9ef9-70250bfc9539 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:05.441679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5c2fb-50a1-4c82-9ef9-70250bfc9539 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:05.441939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5c2fb-50a1-4c82-9ef9-70250bfc9539 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:05.443772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 696/1359] 10.222.0.65 () {54 vars in 961 bytes} [Mon Feb 21 09:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:05.449301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39be8-aeb0-45d7-b82e-56ac19fa35a2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:05.449616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39be8-aeb0-45d7-b82e-56ac19fa35a2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:05.449896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd39be8-aeb0-45d7-b82e-56ac19fa35a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:05.498818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5bd39be8-aeb0-45d7-b82e-56ac19fa35a2 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:05.500217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5bd39be8-aeb0-45d7-b82e-56ac19fa35a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:05.589557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 664/1360] 10.222.0.65 () {58 vars in 1058 bytes} [Mon Feb 21 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:05.597451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5c2fb-50a1-4c82-9ef9-70250bfc9539 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:05.612675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5c2fb-50a1-4c82-9ef9-70250bfc9539 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:05.618094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:05.618732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:05.619013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:05.619311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:05.629022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:05.630018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332814c2-697c-4d97-9871-30b85f09236e service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:05.640768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 697/1361] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:29:08.223332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967343-c749-40df-b135-8d7eded9e1ee None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:08.223903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967343-c749-40df-b135-8d7eded9e1ee None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:08.223903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d967343-c749-40df-b135-8d7eded9e1ee None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:08.225812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 665/1362] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:08.231355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50d09-db9d-4f75-b723-0d04fbebe6f9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:08.231802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50d09-db9d-4f75-b723-0d04fbebe6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:08.231909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50d09-db9d-4f75-b723-0d04fbebe6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:08.250952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-63e50d09-db9d-4f75-b723-0d04fbebe6f9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:08.252187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-63e50d09-db9d-4f75-b723-0d04fbebe6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:08.260224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 698/1363] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:08.305047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d967343-c749-40df-b135-8d7eded9e1ee None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:08.319624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d967343-c749-40df-b135-8d7eded9e1ee None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:08.325105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:08.325808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:08.326178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:08.326522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:08.335182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:08.336890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae6dc-f53c-4f9c-9132-e4e6652bc4b4 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:08.347288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 666/1364] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:11.120760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4002a-30f9-41fe-9231-89d4b11d88b7 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:11.121302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4002a-30f9-41fe-9231-89d4b11d88b7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:11.121302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4002a-30f9-41fe-9231-89d4b11d88b7 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:11.123070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 699/1365] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:11.129548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2c7d-0572-4a92-bbef-7ec857759b6d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:11.130011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2c7d-0572-4a92-bbef-7ec857759b6d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:11.130113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2c7d-0572-4a92-bbef-7ec857759b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:11.150322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-df1a2c7d-0572-4a92-bbef-7ec857759b6d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:11.151859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-df1a2c7d-0572-4a92-bbef-7ec857759b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:11.161290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 667/1366] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:11.207068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799af0-ee06-429c-86c6-160b42575a2f None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:11.207387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799af0-ee06-429c-86c6-160b42575a2f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:11.207664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799af0-ee06-429c-86c6-160b42575a2f None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:11.209415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 700/1367] 10.222.0.65 () {54 vars in 961 bytes} [Mon Feb 21 09:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:11.216479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85220c3-e1a6-4f99-a335-1eb9d2bbe8ff None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:11.216699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85220c3-e1a6-4f99-a335-1eb9d2bbe8ff None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:11.217217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85220c3-e1a6-4f99-a335-1eb9d2bbe8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:11.236421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e85220c3-e1a6-4f99-a335-1eb9d2bbe8ff None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:11.238167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e85220c3-e1a6-4f99-a335-1eb9d2bbe8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:11.247849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 668/1368] 10.222.0.65 () {58 vars in 1058 bytes} [Mon Feb 21 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:11.257268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799af0-ee06-429c-86c6-160b42575a2f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:11.272917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799af0-ee06-429c-86c6-160b42575a2f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:11.278859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:11.279599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:11.280799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:11.281080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:11.290454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:11.292076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b328ed6-4791-4e9f-a8c7-ba010172e385 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:11.302575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 701/1369] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:13.547896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a5cb-c834-46b4-89bc-93a4dccbccbb None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.548793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a5cb-c834-46b4-89bc-93a4dccbccbb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.549109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0a5cb-c834-46b4-89bc-93a4dccbccbb None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.550982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 669/1370] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:13.556986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590ba0-fdbc-4235-b09b-a8e7fd1a9da4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.557503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590ba0-fdbc-4235-b09b-a8e7fd1a9da4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.557613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590ba0-fdbc-4235-b09b-a8e7fd1a9da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.575977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4b590ba0-fdbc-4235-b09b-a8e7fd1a9da4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:13.578279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4b590ba0-fdbc-4235-b09b-a8e7fd1a9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:13.586883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 702/1371] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:13.841017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9bfa-4dd4-4f5a-b8c2-ebebd1641a07 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.841307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9bfa-4dd4-4f5a-b8c2-ebebd1641a07 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.841779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9bfa-4dd4-4f5a-b8c2-ebebd1641a07 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.843892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 670/1372] 10.222.0.65 () {54 vars in 963 bytes} [Mon Feb 21 09:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:13.848675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.848973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.849257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.897146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3611b-d939-4512-9dea-b94764fa594f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.897281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3611b-d939-4512-9dea-b94764fa594f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.897549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3611b-d939-4512-9dea-b94764fa594f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.904628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 671/1373] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:29:13.907240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:13.908040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:13.909246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] MFA Rules not processed for user `8225ba8ede944425a2b21bb4eeb8ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:13.909561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:13.911082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:13.933129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:13.934305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:13.943437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 672/1374] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:13.978922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 703/1375] 10.222.0.65 () {58 vars in 1060 bytes} [Mon Feb 21 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:13.987025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:13.988293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:13.996803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a208-86c8-4010-a49f-edf4486d5f86 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:14.000782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:14.001235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76006d59-3b9c-4065-8523-7e26199ba057 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:14.001673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:14.002032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:14.002915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:14.007698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:14.008405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:14.008755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:14.009107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:14.012665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:14.014215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a42e-787e-4745-a37b-cdf01b4cf2a0 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:14.017417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:14.019670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10e95-da8b-4469-b3bb-07b888871224 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:14.025235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 673/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:14.029930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 704/1377] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:16.513826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c9c7-fa97-4e56-a704-71afac6f1150 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:16.514331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c9c7-fa97-4e56-a704-71afac6f1150 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:16.514331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c9c7-fa97-4e56-a704-71afac6f1150 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:16.516125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 674/1378] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:16.521838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a94b-193c-43da-bf8f-e4c686ddb4b2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:16.522260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a94b-193c-43da-bf8f-e4c686ddb4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:16.522469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a94b-193c-43da-bf8f-e4c686ddb4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:16.540932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-92b4a94b-193c-43da-bf8f-e4c686ddb4b2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:16.542129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-92b4a94b-193c-43da-bf8f-e4c686ddb4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:16.549938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 705/1379] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:16.594946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0c9c7-fa97-4e56-a704-71afac6f1150 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:16.609130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0c9c7-fa97-4e56-a704-71afac6f1150 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:16.615038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:16.615701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:16.615986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:16.616261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:16.624083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:16.625645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf0d37-e765-443b-b56f-e6df075bd0de service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:16.635350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 675/1380] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:19.182973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e69c-097e-4eb0-a1be-f06b801a5cfe None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:19.183450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e69c-097e-4eb0-a1be-f06b801a5cfe None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:19.183652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e69c-097e-4eb0-a1be-f06b801a5cfe None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:19.185323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 706/1381] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:19.191146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b899a-2d1b-408e-a269-95e423aa6776 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:19.191606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b899a-2d1b-408e-a269-95e423aa6776 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:19.192269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b899a-2d1b-408e-a269-95e423aa6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:19.210765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9c3b899a-2d1b-408e-a269-95e423aa6776 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:19.212115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9c3b899a-2d1b-408e-a269-95e423aa6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:19.220363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 676/1382] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:19.266301 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3e69c-097e-4eb0-a1be-f06b801a5cfe None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:19.281312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3e69c-097e-4eb0-a1be-f06b801a5cfe None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:19.286812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:19.287493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:19.287782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:19.288062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:19.296477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:19.298070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa538-c2e6-482d-976e-65bd82c6a297 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:19.307630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 707/1383] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:22.040871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe54a9-26a6-456c-9f34-bda6a8a8cf61 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:22.041376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe54a9-26a6-456c-9f34-bda6a8a8cf61 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:22.041376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe54a9-26a6-456c-9f34-bda6a8a8cf61 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:22.043165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 677/1384] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:22.049142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70f0b-90cc-4bf2-8820-95f610e89017 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:22.049568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70f0b-90cc-4bf2-8820-95f610e89017 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:22.049884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c70f0b-90cc-4bf2-8820-95f610e89017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:22.073144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-23c70f0b-90cc-4bf2-8820-95f610e89017 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:22.074763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-23c70f0b-90cc-4bf2-8820-95f610e89017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:22.085382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 708/1385] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:22.137622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe54a9-26a6-456c-9f34-bda6a8a8cf61 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:22.152886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe54a9-26a6-456c-9f34-bda6a8a8cf61 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:22.160506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:22.161314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:22.161664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:22.162012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:22.172343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:22.174439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811b05-2823-4ede-8ead-a81cc83728d1 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:22.186162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 678/1386] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:24.741960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf779f1-95bf-4e3f-b882-c906f037ac50 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:24.742640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf779f1-95bf-4e3f-b882-c906f037ac50 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:24.742640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf779f1-95bf-4e3f-b882-c906f037ac50 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:24.744380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 709/1387] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:24.750263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769d01-2523-48bf-a9e4-ce885d6907ed None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:24.750701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769d01-2523-48bf-a9e4-ce885d6907ed None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:24.751010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769d01-2523-48bf-a9e4-ce885d6907ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:24.774097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-32769d01-2523-48bf-a9e4-ce885d6907ed None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:24.775764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-32769d01-2523-48bf-a9e4-ce885d6907ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:24.786901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 679/1388] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:24.845420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf779f1-95bf-4e3f-b882-c906f037ac50 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:24.860242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf779f1-95bf-4e3f-b882-c906f037ac50 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:24.865743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:24.866755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:24.867000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:24.867546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:24.875833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:24.877586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8db61-c2ea-40f0-9802-d43b19fb4e24 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:24.887440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 710/1389] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:27.355610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929805a-db7f-4e61-bbcf-1c3dda4e5be1 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:27.356160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929805a-db7f-4e61-bbcf-1c3dda4e5be1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:27.356160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929805a-db7f-4e61-bbcf-1c3dda4e5be1 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:27.357966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 680/1390] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:27.363267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baa3e-15c5-4c3e-b544-0e67ba76cf24 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:27.363739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baa3e-15c5-4c3e-b544-0e67ba76cf24 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:27.363889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70baa3e-15c5-4c3e-b544-0e67ba76cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:27.384029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e70baa3e-15c5-4c3e-b544-0e67ba76cf24 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:27.385282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e70baa3e-15c5-4c3e-b544-0e67ba76cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:27.394068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 711/1391] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:27.438837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929805a-db7f-4e61-bbcf-1c3dda4e5be1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:27.454550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929805a-db7f-4e61-bbcf-1c3dda4e5be1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:27.460577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:27.461230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:27.461517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:27.461837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:27.472599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:27.474426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2fee73-1335-45ec-b0bc-b488840340e0 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:27.489678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 681/1392] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:29.531150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d70d-4ff8-4c42-959d-121a742f1494 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:29.531780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d70d-4ff8-4c42-959d-121a742f1494 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:29.531780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307d70d-4ff8-4c42-959d-121a742f1494 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:29.534184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 712/1393] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:29.539460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fb2c-0e4d-4fde-ad1a-2e4519d4f737 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:29.539889 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fb2c-0e4d-4fde-ad1a-2e4519d4f737 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:29.540028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fb2c-0e4d-4fde-ad1a-2e4519d4f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:29.557532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-bb99fb2c-0e4d-4fde-ad1a-2e4519d4f737 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:29.558714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bb99fb2c-0e4d-4fde-ad1a-2e4519d4f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:29.566553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 682/1394] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:29.623513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865182-9275-480b-bcc8-78cb6568995d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:29.623901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865182-9275-480b-bcc8-78cb6568995d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:29.624251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a865182-9275-480b-bcc8-78cb6568995d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:29.626125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 713/1395] 10.222.0.65 () {54 vars in 962 bytes} [Mon Feb 21 09:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:29.631238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ea0a6-8dfd-42fb-874c-b84344780132 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:29.631641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ea0a6-8dfd-42fb-874c-b84344780132 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:29.631995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ea0a6-8dfd-42fb-874c-b84344780132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:29.681024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-482ea0a6-8dfd-42fb-874c-b84344780132 None None] MFA Rules not processed for user `cac705ffe7884b0db365621e8bd286cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:29.682213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-482ea0a6-8dfd-42fb-874c-b84344780132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:29.739961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 683/1396] 10.222.0.65 () {58 vars in 1059 bytes} [Mon Feb 21 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:29.747312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a865182-9275-480b-bcc8-78cb6568995d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:29.758815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a865182-9275-480b-bcc8-78cb6568995d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:29.762539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:29.768165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:29.768165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:29.768165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:29.773964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:29.775508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cbe40-f08a-4313-8fa2-2fdec9392f14 service glance] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:29.784949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 714/1397] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:29:30.378641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cac19-8e44-44c5-851f-104a0aa51361 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.378933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cac19-8e44-44c5-851f-104a0aa51361 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.379225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cac19-8e44-44c5-851f-104a0aa51361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.438950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-900cac19-8e44-44c5-851f-104a0aa51361 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:30.440788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-900cac19-8e44-44c5-851f-104a0aa51361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:30.452756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52f31-fc46-4215-a30b-db2110b3572a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.453041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52f31-fc46-4215-a30b-db2110b3572a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.453317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52f31-fc46-4215-a30b-db2110b3572a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.455202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 715/1398] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:29:30.460575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.460837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.461107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.479080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:30.480309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:30.488703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 716/1399] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:30.510300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 684/1400] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:30.535086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:30.548464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b3cd0-8ee7-4a8c-a71e-d9e02b2f74fc None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:30.554628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:30.555654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.555940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.556214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.556532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8878e-9126-4556-bc0e-9b6d8197dbed None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.556989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8878e-9126-4556-bc0e-9b6d8197dbed None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.557203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8878e-9126-4556-bc0e-9b6d8197dbed None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.559697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 685/1401] 10.222.0.65 () {54 vars in 942 bytes} [Mon Feb 21 09:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:30.567102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3313b4d-fa77-4e56-87d0-ccb98791b164 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.567440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3313b4d-fa77-4e56-87d0-ccb98791b164 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.567726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3313b4d-fa77-4e56-87d0-ccb98791b164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.569537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:30.571132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:30.584896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 717/1402] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:30.616381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d3313b4d-fa77-4e56-87d0-ccb98791b164 None None] MFA Rules not processed for user `5eccc516e4354bd78f33c775d7f2ac58`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:30.617501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d3313b4d-fa77-4e56-87d0-ccb98791b164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:30.688281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 686/1403] 10.222.0.65 () {58 vars in 1039 bytes} [Mon Feb 21 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:30.697800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:30.708665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da71b8a-6e70-4962-85a7-c9f78c4d07b1 service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:30.714303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:30.715626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:30.716106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:30.716396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:30.725192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:30.726769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273483-ba24-4547-b430-4a99a46dc9f9 service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:30.734584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 718/1404] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:29:33.179891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f895f0-6eee-4e38-8d78-e961c0e2ac32 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:33.181063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f895f0-6eee-4e38-8d78-e961c0e2ac32 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:33.181421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f895f0-6eee-4e38-8d78-e961c0e2ac32 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:33.183243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 687/1405] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:33.188799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1f46-56c1-42f0-89a1-d2d7ea10b99b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:33.189228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1f46-56c1-42f0-89a1-d2d7ea10b99b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:33.189927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1f46-56c1-42f0-89a1-d2d7ea10b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:33.209212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-46ce1f46-56c1-42f0-89a1-d2d7ea10b99b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:33.210728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-46ce1f46-56c1-42f0-89a1-d2d7ea10b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:33.219585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 719/1406] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:33.265002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f895f0-6eee-4e38-8d78-e961c0e2ac32 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:33.280098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f895f0-6eee-4e38-8d78-e961c0e2ac32 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:33.289800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:33.290448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:33.290726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:33.290994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:33.303009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:33.304969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2a5e9-0013-48c1-b203-dcae0716318d service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:33.315147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 688/1407] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:36.564838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd9fb-4a1d-42a6-8b69-a33b7ef92a99 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:36.565420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd9fb-4a1d-42a6-8b69-a33b7ef92a99 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:36.565420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fd9fb-4a1d-42a6-8b69-a33b7ef92a99 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:36.567183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 720/1408] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:36.572406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343acf2-e041-41e9-8e66-99df51f6e150 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:36.573266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343acf2-e041-41e9-8e66-99df51f6e150 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:36.573724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343acf2-e041-41e9-8e66-99df51f6e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:36.592305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2343acf2-e041-41e9-8e66-99df51f6e150 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:36.593503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2343acf2-e041-41e9-8e66-99df51f6e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:36.601726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 689/1409] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:36.646021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fd9fb-4a1d-42a6-8b69-a33b7ef92a99 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:36.661742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fd9fb-4a1d-42a6-8b69-a33b7ef92a99 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:36.667595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:36.668331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:36.668626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:36.668909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:36.677259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:36.678848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80d9e9-be37-4f49-9181-3cbd03c921bf service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:36.692378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 721/1410] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:55.483618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe4a3-bf3d-4667-912f-e1a072db28f8 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:55.484252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe4a3-bf3d-4667-912f-e1a072db28f8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:55.484252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe4a3-bf3d-4667-912f-e1a072db28f8 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:55.485996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 690/1411] 10.222.0.65 () {54 vars in 918 bytes} [Mon Feb 21 09:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:55.492000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee39bc-defb-48a2-9dd7-4abd928ca843 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:55.492502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee39bc-defb-48a2-9dd7-4abd928ca843 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:55.492712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee39bc-defb-48a2-9dd7-4abd928ca843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:55.510537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7aee39bc-defb-48a2-9dd7-4abd928ca843 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:55.511760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7aee39bc-defb-48a2-9dd7-4abd928ca843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:55.520568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 722/1412] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Feb 21 09:29:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:29:55.535071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a02d-05b0-4c9f-a315-05ef036c0f3c None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:55.535397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a02d-05b0-4c9f-a315-05ef036c0f3c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:55.535676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0a02d-05b0-4c9f-a315-05ef036c0f3c None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:55.537418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 691/1413] 10.222.0.65 () {54 vars in 918 bytes} [Mon Feb 21 09:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:55.542162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79f30-a1c4-4d27-a46e-50fe5f99f272 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:55.542453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79f30-a1c4-4d27-a46e-50fe5f99f272 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:55.542730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a79f30-a1c4-4d27-a46e-50fe5f99f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:55.560671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-57a79f30-a1c4-4d27-a46e-50fe5f99f272 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:55.561865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-57a79f30-a1c4-4d27-a46e-50fe5f99f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:55.570738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 723/1414] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Feb 21 09:29:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:58.299745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c4c-8eed-44d6-ba23-50170da52f73 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:58.300278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c4c-8eed-44d6-ba23-50170da52f73 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:58.300278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91941c4c-8eed-44d6-ba23-50170da52f73 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:58.301988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 692/1415] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:58.307176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2e30-dc2c-4100-96a4-78a7a9a33e5f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:58.307597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2e30-dc2c-4100-96a4-78a7a9a33e5f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:58.307771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c2e30-dc2c-4100-96a4-78a7a9a33e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:58.325149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-444c2e30-dc2c-4100-96a4-78a7a9a33e5f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:58.326328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-444c2e30-dc2c-4100-96a4-78a7a9a33e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:58.334096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 724/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:58.375951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941c4c-8eed-44d6-ba23-50170da52f73 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:29:58.389976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91941c4c-8eed-44d6-ba23-50170da52f73 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:29:58.395361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:29:58.395991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:58.396280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:58.396560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:58.404701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:29:58.406280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53a2cb-f513-4691-a556-8315908d0d87 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:29:58.416388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 693/1417] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:29:59.777869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ebb69-b506-401e-9402-4531a257e552 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:59.778777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ebb69-b506-401e-9402-4531a257e552 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:59.778777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ebb69-b506-401e-9402-4531a257e552 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:59.780911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 725/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:29:59.786520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5bcd-6597-4779-b641-5b88c729bd68 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:29:59.787004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5bcd-6597-4779-b641-5b88c729bd68 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:29:59.787140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b5bcd-6597-4779-b641-5b88c729bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:29:59.805621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-482b5bcd-6597-4779-b641-5b88c729bd68 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:29:59.806838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-482b5bcd-6597-4779-b641-5b88c729bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:29:59.814770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 694/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:29:59.994172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ebb69-b506-401e-9402-4531a257e552 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:00.008263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ebb69-b506-401e-9402-4531a257e552 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:00.013892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:00.014537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:00.014823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:00.015101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:00.023701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:00.025570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dad9a-e8d4-43c3-92f1-7207efc24b38 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:00.035369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 726/1420] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:01.357016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c798-7935-47ae-8669-585eff624f15 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:01.357559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c798-7935-47ae-8669-585eff624f15 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:01.357559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c798-7935-47ae-8669-585eff624f15 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:01.359371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 695/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:01.364553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf3f2-fff0-4695-92d9-ffe756ec8a4a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:01.364987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf3f2-fff0-4695-92d9-ffe756ec8a4a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:01.365125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf3f2-fff0-4695-92d9-ffe756ec8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:01.383248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-da3cf3f2-fff0-4695-92d9-ffe756ec8a4a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:01.384470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-da3cf3f2-fff0-4695-92d9-ffe756ec8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:01.392426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 727/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:01.545216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c798-7935-47ae-8669-585eff624f15 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:01.559836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c798-7935-47ae-8669-585eff624f15 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:01.565147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:01.566350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:01.566637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:01.566916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:01.575219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:01.577325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86bd56-3690-4ea3-8ecd-d2a56cfcc059 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:01.586465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 696/1423] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:02.880940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc338-6b9a-489d-96ec-676ae85b4777 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:02.881494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc338-6b9a-489d-96ec-676ae85b4777 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:02.881688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc338-6b9a-489d-96ec-676ae85b4777 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:02.883287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 728/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:02.888313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737e7c-c256-4f5c-8c49-8d6e2c2c534d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:02.888742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737e7c-c256-4f5c-8c49-8d6e2c2c534d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:02.888855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737e7c-c256-4f5c-8c49-8d6e2c2c534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:02.909032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-72737e7c-c256-4f5c-8c49-8d6e2c2c534d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:02.913083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-72737e7c-c256-4f5c-8c49-8d6e2c2c534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:02.923098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 697/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:03.073532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc338-6b9a-489d-96ec-676ae85b4777 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:03.087670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dc338-6b9a-489d-96ec-676ae85b4777 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:03.092976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:03.093598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:03.093877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:03.094150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:03.102175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:03.103877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae13f0-fc36-465d-8608-49c44e54fe56 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:03.114543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 729/1426] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:04.434353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf099-64a1-4661-855a-cdc63041005d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:04.434917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf099-64a1-4661-855a-cdc63041005d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:04.434917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf099-64a1-4661-855a-cdc63041005d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:04.436759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 698/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:04.442218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260c00-f614-47e1-9186-d864f728acd8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:04.442667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260c00-f614-47e1-9186-d864f728acd8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:04.442787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260c00-f614-47e1-9186-d864f728acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:04.460868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9f260c00-f614-47e1-9186-d864f728acd8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:04.462026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9f260c00-f614-47e1-9186-d864f728acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:04.470246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 730/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:04.620419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf099-64a1-4661-855a-cdc63041005d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:04.635027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf099-64a1-4661-855a-cdc63041005d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:04.640364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:04.640988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:04.641273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:04.641546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:04.650216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:04.651825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39e88-4fc5-42d6-8b32-d9e3a7322af3 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:04.660943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 699/1429] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:05.963590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c07f-ca5b-4a3c-bbda-eb643cce879d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:05.964064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c07f-ca5b-4a3c-bbda-eb643cce879d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:05.964163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c07f-ca5b-4a3c-bbda-eb643cce879d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:05.965974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 731/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:05.970965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6782ec-fcd2-4455-8cdd-70203892dd0a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:05.971389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6782ec-fcd2-4455-8cdd-70203892dd0a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:05.971561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6782ec-fcd2-4455-8cdd-70203892dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:05.989481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6e6782ec-fcd2-4455-8cdd-70203892dd0a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:05.990721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6e6782ec-fcd2-4455-8cdd-70203892dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:05.998548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 700/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:06.151771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c07f-ca5b-4a3c-bbda-eb643cce879d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:06.166256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c07f-ca5b-4a3c-bbda-eb643cce879d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:06.172442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:06.173087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:06.174623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:06.174915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:06.187501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:06.189119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17052c1-699e-41f2-b4b2-f5accc7b3b35 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:06.203390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 732/1432] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:07.507873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1d-f24a-4597-8322-11b18d6ffe4d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:07.508398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1d-f24a-4597-8322-11b18d6ffe4d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:07.508499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c2c1d-f24a-4597-8322-11b18d6ffe4d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:07.510319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 701/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:07.515552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54f43-8bc2-4055-b476-dd3aa1921edf None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:07.516009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54f43-8bc2-4055-b476-dd3aa1921edf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:07.516305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b54f43-8bc2-4055-b476-dd3aa1921edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:07.539202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-23b54f43-8bc2-4055-b476-dd3aa1921edf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:07.540847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-23b54f43-8bc2-4055-b476-dd3aa1921edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:07.550598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 733/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:07.702288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c2c1d-f24a-4597-8322-11b18d6ffe4d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:07.717461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c2c1d-f24a-4597-8322-11b18d6ffe4d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:07.723645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:07.724311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:07.724597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:07.724875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:07.734107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:07.735803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53508c0a-3bb2-4c90-ad47-79fb6fd9315c service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:07.746781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 702/1435] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:09.082718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6577e4-ce31-47da-87d2-4a555ecf0a1c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:09.083284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6577e4-ce31-47da-87d2-4a555ecf0a1c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:09.083284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6577e4-ce31-47da-87d2-4a555ecf0a1c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:09.085141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 734/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:09.090092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6557-8f0c-4943-982e-9e2dd42a31c7 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:09.090497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6557-8f0c-4943-982e-9e2dd42a31c7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:09.090651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc6557-8f0c-4943-982e-9e2dd42a31c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:09.109540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-eefc6557-8f0c-4943-982e-9e2dd42a31c7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:09.110709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-eefc6557-8f0c-4943-982e-9e2dd42a31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:09.118483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 703/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:09.267412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6577e4-ce31-47da-87d2-4a555ecf0a1c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:09.282021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6577e4-ce31-47da-87d2-4a555ecf0a1c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:09.287989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:09.288614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:09.288896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:09.289172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:09.296959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:09.298523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33437ff1-8a10-425b-b333-c2396286743b service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:09.307584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 735/1438] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:10.661109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76d1-60b3-4b15-b81f-e44167278935 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:10.661669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76d1-60b3-4b15-b81f-e44167278935 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:10.661669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76d1-60b3-4b15-b81f-e44167278935 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:10.663429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 704/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:10.668322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a55e-10a6-4b37-bb44-fcd699a3312d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:10.668742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a55e-10a6-4b37-bb44-fcd699a3312d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:10.668881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a55e-10a6-4b37-bb44-fcd699a3312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:10.686905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0440a55e-10a6-4b37-bb44-fcd699a3312d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:10.688144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0440a55e-10a6-4b37-bb44-fcd699a3312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:10.696408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 736/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:30:10.845952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76d1-60b3-4b15-b81f-e44167278935 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:10.859705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76d1-60b3-4b15-b81f-e44167278935 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:10.865434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:10.866088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:10.866370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:10.866643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:10.874674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:10.876268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf6106-0f30-4a0e-ba4e-82f73c7f9e9b service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:10.885856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 705/1441] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:13.075062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811e6f-3b43-45db-a5a8-7030ba23cc4b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:13.075658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811e6f-3b43-45db-a5a8-7030ba23cc4b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:13.075763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80811e6f-3b43-45db-a5a8-7030ba23cc4b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:13.077501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 737/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:13.083112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d72-b93e-4d69-9c84-6d06d505051e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:13.083519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d72-b93e-4d69-9c84-6d06d505051e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:13.083723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a4d72-b93e-4d69-9c84-6d06d505051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:13.101609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f03a4d72-b93e-4d69-9c84-6d06d505051e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:13.102788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f03a4d72-b93e-4d69-9c84-6d06d505051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:13.110529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 706/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:13.149353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811e6f-3b43-45db-a5a8-7030ba23cc4b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:13.160059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80811e6f-3b43-45db-a5a8-7030ba23cc4b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:13.163582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:13.164214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:13.164505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:13.164780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:13.173477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:13.174911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64be8-9af8-4bcf-ab03-1560adccc763 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:13.184042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 738/1444] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:15.622599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7987-6355-4105-a46f-b251250b5797 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:15.623167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7987-6355-4105-a46f-b251250b5797 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:15.623282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb7987-6355-4105-a46f-b251250b5797 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:15.625037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 707/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:15.630969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb856b8-8fc2-4621-b849-423f523d10fd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:15.631430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb856b8-8fc2-4621-b849-423f523d10fd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:15.631584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb856b8-8fc2-4621-b849-423f523d10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:15.649692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-beb856b8-8fc2-4621-b849-423f523d10fd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:15.650865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-beb856b8-8fc2-4621-b849-423f523d10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:15.658810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 739/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:15.696208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7987-6355-4105-a46f-b251250b5797 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:15.707234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb7987-6355-4105-a46f-b251250b5797 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:15.710756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:15.711450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:15.711735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:15.712011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:15.720639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:15.722057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469805b-a9e9-43c1-a1dd-34401a78ce9d service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:15.731147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 708/1447] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:18.371482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429e06-fac5-48f4-b4a7-1699f45c1f0b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:18.372048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429e06-fac5-48f4-b4a7-1699f45c1f0b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:18.372048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429e06-fac5-48f4-b4a7-1699f45c1f0b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:18.373805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 740/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:18.379072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bcca-4f2e-4f7c-b211-2fff4e5abe10 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:18.379544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bcca-4f2e-4f7c-b211-2fff4e5abe10 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:18.379684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bcca-4f2e-4f7c-b211-2fff4e5abe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:18.400416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cd74bcca-4f2e-4f7c-b211-2fff4e5abe10 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:18.401605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cd74bcca-4f2e-4f7c-b211-2fff4e5abe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:18.409382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 709/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:18.448929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429e06-fac5-48f4-b4a7-1699f45c1f0b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:18.459667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429e06-fac5-48f4-b4a7-1699f45c1f0b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:18.463234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:18.463912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:18.464200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:18.464480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:18.473798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:18.475262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc1f50-a344-4613-bb6a-2349857fe3e3 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:18.484581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 741/1450] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:20.925543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c5de-e288-4854-996d-68ddf85d5bf9 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:20.926076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c5de-e288-4854-996d-68ddf85d5bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:20.926076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c5de-e288-4854-996d-68ddf85d5bf9 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:20.927895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 710/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:20.933232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd56c2-f0d4-434f-a4a4-70217d1618f0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:20.933656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd56c2-f0d4-434f-a4a4-70217d1618f0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:20.933790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd56c2-f0d4-434f-a4a4-70217d1618f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:20.953071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5cfd56c2-f0d4-434f-a4a4-70217d1618f0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:20.954261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5cfd56c2-f0d4-434f-a4a4-70217d1618f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:20.962819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 742/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:21.001757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c5de-e288-4854-996d-68ddf85d5bf9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:21.012984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c5de-e288-4854-996d-68ddf85d5bf9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:21.016697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:21.017329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:21.017615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:21.017896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:21.027574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:21.028990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3f2fc-a880-42b7-abd2-51f989d7ade0 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:21.038322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 711/1453] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:23.409070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa523b5-791a-465d-b1e9-cbb43c5ca40c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:23.409729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa523b5-791a-465d-b1e9-cbb43c5ca40c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:23.409729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa523b5-791a-465d-b1e9-cbb43c5ca40c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:23.411442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 743/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:23.416710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e9e65-5034-447f-9425-df2dd51ec376 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:23.417146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e9e65-5034-447f-9425-df2dd51ec376 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:23.417283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e9e65-5034-447f-9425-df2dd51ec376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:23.435527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-101e9e65-5034-447f-9425-df2dd51ec376 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:23.436701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-101e9e65-5034-447f-9425-df2dd51ec376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:23.444940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 712/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:23.482060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa523b5-791a-465d-b1e9-cbb43c5ca40c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:23.492992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa523b5-791a-465d-b1e9-cbb43c5ca40c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:23.496434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:23.497052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:23.497333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:23.497607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:23.506739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:23.508191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480ac03-1a3c-4572-95cc-8aa1a57aeb92 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:23.517390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 744/1456] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:25.963931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20c5e-93a1-45a0-8794-8575e7562ded None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:25.964365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20c5e-93a1-45a0-8794-8575e7562ded None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:25.964486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a20c5e-93a1-45a0-8794-8575e7562ded None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:25.966272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 713/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:25.973045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a581-158a-4444-b02f-4f897a6379be None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:25.973568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a581-158a-4444-b02f-4f897a6379be None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:25.973703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2a581-158a-4444-b02f-4f897a6379be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:25.991770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2ae2a581-158a-4444-b02f-4f897a6379be None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:25.992976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2ae2a581-158a-4444-b02f-4f897a6379be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:26.000998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 745/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:26.039576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20c5e-93a1-45a0-8794-8575e7562ded None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:26.050640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a20c5e-93a1-45a0-8794-8575e7562ded None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:26.054213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:26.054845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:26.055129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:26.055435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:26.064352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:26.065809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371365f-9fb2-4c70-93e6-8fda894b6053 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:26.075197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 714/1459] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:28.425103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387870c1-d0d1-40a3-a236-98a5b0184e8d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:28.425668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387870c1-d0d1-40a3-a236-98a5b0184e8d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:28.425841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387870c1-d0d1-40a3-a236-98a5b0184e8d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:28.427614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 746/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:28.433003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e53f-1004-4765-8214-796a5c7e45c4 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:28.433510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e53f-1004-4765-8214-796a5c7e45c4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:28.433786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e53f-1004-4765-8214-796a5c7e45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:28.451754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5715e53f-1004-4765-8214-796a5c7e45c4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:28.452925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5715e53f-1004-4765-8214-796a5c7e45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:28.461287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 715/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:30:28.498151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387870c1-d0d1-40a3-a236-98a5b0184e8d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:28.509075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387870c1-d0d1-40a3-a236-98a5b0184e8d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:28.512545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:28.513176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:28.513458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:28.513731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:28.522975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:28.524698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43adf-0a15-468c-b65d-d2adb6fbc38f service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:28.533769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 747/1462] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:30:30.900516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993849c-9adf-4629-9bbd-3f555156b02c None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:30.901056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993849c-9adf-4629-9bbd-3f555156b02c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:30.901056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993849c-9adf-4629-9bbd-3f555156b02c None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:30.903969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 716/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:30.909017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7177e-cb7c-4e33-b095-6a830bd28cd4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:30.909418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7177e-cb7c-4e33-b095-6a830bd28cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:30.909736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7177e-cb7c-4e33-b095-6a830bd28cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:30.929944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a9e7177e-cb7c-4e33-b095-6a830bd28cd4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:30.931163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a9e7177e-cb7c-4e33-b095-6a830bd28cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:30.939219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 748/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:30.977352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993849c-9adf-4629-9bbd-3f555156b02c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:30.988654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993849c-9adf-4629-9bbd-3f555156b02c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:30.992339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:30.993086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:30.993374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:30.993698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:31.005038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:31.006500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745f7af-16f0-4b88-923e-f4128f5e9a77 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:31.016665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 717/1465] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:33.490032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8617e2-67c5-4fbb-ae85-0b790043bf12 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:33.490533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8617e2-67c5-4fbb-ae85-0b790043bf12 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:33.490533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8617e2-67c5-4fbb-ae85-0b790043bf12 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:33.492379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 749/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:33.497775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de038d6-92c9-4c10-8856-41db3f278284 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:33.498218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de038d6-92c9-4c10-8856-41db3f278284 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:33.498336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de038d6-92c9-4c10-8856-41db3f278284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:33.516629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9de038d6-92c9-4c10-8856-41db3f278284 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:33.517811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9de038d6-92c9-4c10-8856-41db3f278284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:33.525899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 718/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:33.563113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8617e2-67c5-4fbb-ae85-0b790043bf12 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:33.576084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8617e2-67c5-4fbb-ae85-0b790043bf12 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:33.579762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:33.580400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:33.580687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:33.581012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:33.590742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:33.592231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788ecd5-bb89-4383-a96d-1a857d1a0c58 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:33.602315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 750/1468] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:35.916532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba897-6f82-4833-aae7-b1616495512f None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:35.917085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba897-6f82-4833-aae7-b1616495512f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:35.917085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dba897-6f82-4833-aae7-b1616495512f None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:35.918874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 719/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:35.924379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b669-3aa7-45fb-875c-f71c22bf7673 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:35.924881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b669-3aa7-45fb-875c-f71c22bf7673 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:35.925574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b669-3aa7-45fb-875c-f71c22bf7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:35.944117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2537b669-3aa7-45fb-875c-f71c22bf7673 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:35.945386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2537b669-3aa7-45fb-875c-f71c22bf7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:35.953535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 751/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:35.990332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dba897-6f82-4833-aae7-b1616495512f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:36.001357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dba897-6f82-4833-aae7-b1616495512f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:36.005196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:36.005850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:36.006136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:36.006411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:36.015737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:36.017201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61975702-dc33-4d72-8158-947127c219d6 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:36.027644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 720/1471] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:56.726438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5027a8-d175-4ee4-910b-82b7a94d6c1e None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:56.727021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5027a8-d175-4ee4-910b-82b7a94d6c1e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:56.727021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5027a8-d175-4ee4-910b-82b7a94d6c1e None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:56.728845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 752/1472] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:30:56.734073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a83ae-6cd3-4382-9a23-b47af5847d7e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:56.734525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a83ae-6cd3-4382-9a23-b47af5847d7e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:56.734633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a83ae-6cd3-4382-9a23-b47af5847d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:56.752353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f08a83ae-6cd3-4382-9a23-b47af5847d7e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:56.753543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f08a83ae-6cd3-4382-9a23-b47af5847d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:56.761798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 721/1473] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:56.808119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309d07-7d53-4274-b2f5-93a891aa2a9b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:56.808410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309d07-7d53-4274-b2f5-93a891aa2a9b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:56.808686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309d07-7d53-4274-b2f5-93a891aa2a9b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:56.810504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 753/1474] 10.222.0.65 () {54 vars in 962 bytes} [Mon Feb 21 09:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:30:56.815096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16ca6-d5b5-4aa3-964f-fae70390b9a2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:56.815416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16ca6-d5b5-4aa3-964f-fae70390b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:56.815695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16ca6-d5b5-4aa3-964f-fae70390b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:56.834681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ecf16ca6-d5b5-4aa3-964f-fae70390b9a2 None None] MFA Rules not processed for user `cac705ffe7884b0db365621e8bd286cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:56.835887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ecf16ca6-d5b5-4aa3-964f-fae70390b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:56.842284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 722/1475] 10.222.0.65 () {58 vars in 1059 bytes} [Mon Feb 21 09:30:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:56.850008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25309d07-7d53-4274-b2f5-93a891aa2a9b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:56.860324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25309d07-7d53-4274-b2f5-93a891aa2a9b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:56.864373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:56.864994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:56.865273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:56.865544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:56.874115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:56.875558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e5d02-fe69-4728-8eeb-5ad07596e80d service glance] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:56.884560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 754/1476] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:30:59.251516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047f2d-d233-4574-a9c4-fd8078712db4 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:59.252082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047f2d-d233-4574-a9c4-fd8078712db4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:59.252082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047f2d-d233-4574-a9c4-fd8078712db4 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:59.254606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 723/1477] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:30:59.259864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e17a-b30c-4ca9-a7cc-4c88ce751b29 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:59.260548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e17a-b30c-4ca9-a7cc-4c88ce751b29 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:59.260703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e17a-b30c-4ca9-a7cc-4c88ce751b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:59.278257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7934e17a-b30c-4ca9-a7cc-4c88ce751b29 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:30:59.279477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7934e17a-b30c-4ca9-a7cc-4c88ce751b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:30:59.287191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 755/1478] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:30:59.310455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047f2d-d233-4574-a9c4-fd8078712db4 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:30:59.323149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca047f2d-d233-4574-a9c4-fd8078712db4 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:30:59.327594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:30:59.328228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:30:59.328511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:30:59.328787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:30:59.329504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:30:59.331374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fded5-094e-47b9-a19a-230f6db00240 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:30:59.350788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 724/1479] 10.222.0.65 () {56 vars in 1108 bytes} [Mon Feb 21 09:30:59 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:31:01.692476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8b47-7d0b-47a7-96ac-72638bf5187d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:01.693009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8b47-7d0b-47a7-96ac-72638bf5187d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:01.693009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c8b47-7d0b-47a7-96ac-72638bf5187d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:01.694785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 756/1480] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:31:01.699907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e1f7-18fd-4a77-b29c-dd26e1b39b7d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:01.700305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e1f7-18fd-4a77-b29c-dd26e1b39b7d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:01.700472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5e1f7-18fd-4a77-b29c-dd26e1b39b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:01.718324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-60e5e1f7-18fd-4a77-b29c-dd26e1b39b7d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:31:01.719545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-60e5e1f7-18fd-4a77-b29c-dd26e1b39b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:01.727244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 725/1481] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:31:01.768749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8b47-7d0b-47a7-96ac-72638bf5187d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:31:01.783313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c8b47-7d0b-47a7-96ac-72638bf5187d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:31:01.788838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:31:01.789469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:01.789753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:01.790090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:01.798067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:31:01.799682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3f600-6cc4-4ccf-98fc-7abd77a4f75c service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:31:01.809512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 757/1482] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:31:04.273123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a62fa-b98e-4467-aef2-c6fdefc4e3b5 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:04.273562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a62fa-b98e-4467-aef2-c6fdefc4e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:04.273674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a62fa-b98e-4467-aef2-c6fdefc4e3b5 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:04.275823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 726/1483] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:31:04.282138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e3d2-a492-4764-aa41-7bbfa63dac0d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:04.282575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e3d2-a492-4764-aa41-7bbfa63dac0d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:04.282714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e3d2-a492-4764-aa41-7bbfa63dac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:04.300523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1776e3d2-a492-4764-aa41-7bbfa63dac0d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:31:04.301732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1776e3d2-a492-4764-aa41-7bbfa63dac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:04.309615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 758/1484] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:31:04.345999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a62fa-b98e-4467-aef2-c6fdefc4e3b5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:31:04.356768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a62fa-b98e-4467-aef2-c6fdefc4e3b5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:31:04.360327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:31:04.360962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:04.361250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:04.361531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:04.370130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:31:04.371591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae313b5-3098-433d-9ec0-02275947c90a service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:31:04.381139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 727/1485] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:31:06.759175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf468eb-e690-46c1-b1a2-92ea63d8f3b7 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:06.759730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf468eb-e690-46c1-b1a2-92ea63d8f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:06.759860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf468eb-e690-46c1-b1a2-92ea63d8f3b7 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:06.761559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 759/1486] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:31:06.766690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8ceb-3124-4211-9391-c844746250f6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:06.767089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8ceb-3124-4211-9391-c844746250f6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:06.767238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8ceb-3124-4211-9391-c844746250f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:06.785420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b6fc8ceb-3124-4211-9391-c844746250f6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:31:06.787211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b6fc8ceb-3124-4211-9391-c844746250f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:06.794906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 728/1487] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:31:06.832270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf468eb-e690-46c1-b1a2-92ea63d8f3b7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:31:06.843566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf468eb-e690-46c1-b1a2-92ea63d8f3b7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:31:06.847049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:31:06.847712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:06.847993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:06.848905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:06.857490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:31:06.858922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c40489-24b5-4f7c-81d7-6dad84563a6a service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:31:06.868645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 760/1488] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:31:09.275945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:09.276487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:09.276487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:09.278290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 729/1489] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:31:09.283439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68138-a590-4ab8-8c3b-b525864a8440 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:09.283822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68138-a590-4ab8-8c3b-b525864a8440 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:09.284004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68138-a590-4ab8-8c3b-b525864a8440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:09.302558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-77c68138-a590-4ab8-8c3b-b525864a8440 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:31:09.303789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-77c68138-a590-4ab8-8c3b-b525864a8440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:09.311481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 761/1490] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:31:09.352323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:31:09.354009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:09.367437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b73a8-f31d-4874-ac3a-97fe6ca63c3d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:31:09.371035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:31:09.371695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:09.371982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:09.372257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:09.381107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:31:09.382525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19587cfb-af76-4c3f-b2fb-fa682517496a service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:31:09.391758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 730/1491] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:31:12.309276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95650d1-ef46-4ea6-9c1a-bc783c11e0f2 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:12.309784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95650d1-ef46-4ea6-9c1a-bc783c11e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:12.309784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95650d1-ef46-4ea6-9c1a-bc783c11e0f2 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:12.311599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 762/1492] 10.222.0.65 () {54 vars in 926 bytes} [Mon Feb 21 09:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:31:12.316648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce2c1-3b76-49af-bf1b-3fc9bc54f962 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:12.317632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce2c1-3b76-49af-bf1b-3fc9bc54f962 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:12.317833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ce2c1-3b76-49af-bf1b-3fc9bc54f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:12.335167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-097ce2c1-3b76-49af-bf1b-3fc9bc54f962 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:31:12.336391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-097ce2c1-3b76-49af-bf1b-3fc9bc54f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:31:12.345999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 731/1493] 10.222.0.65 () {58 vars in 1023 bytes} [Mon Feb 21 09:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:31:12.384778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95650d1-ef46-4ea6-9c1a-bc783c11e0f2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:31:12.395261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95650d1-ef46-4ea6-9c1a-bc783c11e0f2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:31:12.398915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:31:12.399835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:31:12.400128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:31:12.400401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:31:12.409053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:31:12.411027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666a2d1-c80d-47aa-b494-3302feafc274 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:31:12.419947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 763/1494] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:33:05.662178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:05.662742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:05.662850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:05.681694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:33:05.682896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:05.690676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 732/1495] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:33:05.699028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:05.699559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:05.699758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:05.718173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:33:05.719419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:05.727402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 764/1496] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:33:05.731706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:05.741163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8a84-c0d1-4b2e-ac5c-dc34e9a1737a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:05.745617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:05.746316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:05.746605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:05.746883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:05.747634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:33:05.747940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:05.749533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:05.760626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 733/1497] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:33:05.768917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:05.778764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fc303-5aed-485a-8bd5-555e9dc858e2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:05.783401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:05.784047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:05.784334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:05.784647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:05.785333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:05.787231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:05.904694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 765/1498] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:33:05 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:33:05.908802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:05.918462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583397-2dcd-46ca-8764-0d31212d4cb7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:05.971751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:05.972413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:05.972705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:05.972980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:05.973657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:05.975605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.109007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 734/1499] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:33:05 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:33:06.114652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:06.125302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fae20-bd12-45b0-afe4-f924fcc9c092 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:06.129983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:06.133007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.133007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.133007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.133007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:06.133602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.147490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 766/1500] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:33:06.151879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:06.161971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8e15f-b97d-4df5-9305-d9aa9d878b0b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:06.166446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:06.167101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.168019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.168298 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.169324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:06.170932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc11c5f-1d48-4eed-a5ce-09a300eabc41 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.187333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 735/1501] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:33:06.189316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:06.200127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471fc9e-8f31-438f-8d75-02b08c0c6880 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:06.204868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:06.205756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.206046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.206328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] PATH_INFO: `/v3/projects/790f7d6dbd7743e4ad6144313407b4ba/users/880f3079bfce49d89b948cfeed3b025e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.222706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790f7d6dbd7743e4ad6144313407b4ba, user_id=880f3079bfce49d89b948cfeed3b025e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:06.225493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.310640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 767/1502] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:33:06 2022] PUT /identity/v3/projects/790f7d6dbd7743e4ad6144313407b4ba/users/880f3079bfce49d89b948cfeed3b025e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:33:06.322149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15780-c034-41ab-9d26-cb61b23ae534 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.322530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15780-c034-41ab-9d26-cb61b23ae534 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.322812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15780-c034-41ab-9d26-cb61b23ae534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.349231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-09a15780-c034-41ab-9d26-cb61b23ae534 None None] MFA Rules not processed for user `880f3079bfce49d89b948cfeed3b025e`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:33:06.350480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-09a15780-c034-41ab-9d26-cb61b23ae534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:06.414891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 736/1503] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:33:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:33:06.426458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:06.494501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece41ca9-4251-429a-ba96-1a7aff9c0b61 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:06.500502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:06.501137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.501419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.501695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.509384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:06.510955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.519349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 768/1504] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:33:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:33:06.599228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fd834-fd38-4525-8105-88a08727ce93 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.599552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fd834-fd38-4525-8105-88a08727ce93 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.599828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fd834-fd38-4525-8105-88a08727ce93 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.601847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 737/1505] 10.222.0.65 () {52 vars in 829 bytes} [Mon Feb 21 09:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:33:06.605968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:06.663849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0fc0-fe7c-4faa-ab1b-9259f62bb2dd service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:06.668997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:06.669784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:06.670064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:06.670338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] PATH_INFO: `/v3/users/880f3079bfce49d89b948cfeed3b025e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:06.671522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=880f3079bfce49d89b948cfeed3b025e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:06.672546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:33:06.672546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:33:06.672546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:33:06.673750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:06.915113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880f3079bfce49d89b948cfeed3b025e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:06.933807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880f3079bfce49d89b948cfeed3b025e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.017350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880f3079bfce49d89b948cfeed3b025e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.018081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880f3079bfce49d89b948cfeed3b025e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.018698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880f3079bfce49d89b948cfeed3b025e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.042747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 769/1506] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:33:06 2022] DELETE /identity/v3/users/880f3079bfce49d89b948cfeed3b025e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:33:07.047208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:07.047739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:07.047841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:07.065561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:33:07.066748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:07.123802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 738/1507] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:33:07.133251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:07.134668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:07.191089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1708d-a3fc-4ed7-82c3-3036db26ba4b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:07.195139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:07.195822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:07.196112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:07.196394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:07.205287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:07.206722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5434a9-5e2b-4000-999e-185b5ac74cb7 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:07.215986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 770/1508] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:33:07.710723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:33:07.712224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:33:07.724344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ece8a-037f-4ec9-b549-938956d94d3d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:33:07.733405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:33:07.733405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:33:07.733405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:33:07.733405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] PATH_INFO: `/v3/projects/790f7d6dbd7743e4ad6144313407b4ba` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:33:07.740843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=790f7d6dbd7743e4ad6144313407b4ba)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:33:07.740843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:33:07.740843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:33:07.740843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:33:07.740843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:33:07.878135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790f7d6dbd7743e4ad6144313407b4ba', 'request_id': 'req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.891733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790f7d6dbd7743e4ad6144313407b4ba', 'request_id': 'req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.897402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790f7d6dbd7743e4ad6144313407b4ba', 'request_id': 'req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.976934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] The token cache is being invalidate because project 790f7d6dbd7743e4ad6144313407b4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:33:07.977160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.977793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ea7fa9bb-9865-47a6-a2f7-85005d67fadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:33:07.979555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 739/1509] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:33:07 2022] DELETE /identity/v3/projects/790f7d6dbd7743e4ad6144313407b4ba => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:34:53.614193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf4bd-5ff4-47e2-bdeb-1a755565d7cf None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:53.614771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf4bd-5ff4-47e2-bdeb-1a755565d7cf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:53.614771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf4bd-5ff4-47e2-bdeb-1a755565d7cf None None] PATH_INFO: `/v3` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:53.616072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 771/1510] 10.222.0.42 () {54 vars in 925 bytes} [Mon Feb 21 09:34:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:34:53.636902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15d17-9708-49e9-8f1f-0a3aeae446e8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:53.637369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15d17-9708-49e9-8f1f-0a3aeae446e8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:53.637471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15d17-9708-49e9-8f1f-0a3aeae446e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:53.656629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4ec15d17-9708-49e9-8f1f-0a3aeae446e8 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:34:53.657857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4ec15d17-9708-49e9-8f1f-0a3aeae446e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:34:53.720137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 740/1511] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Feb 21 09:34:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:34:54.031971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:54.032263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:54.032547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:54.034385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 772/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:34:54.039772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afac1-f0ef-4341-9b40-3eed95ad9da8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:54.040072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afac1-f0ef-4341-9b40-3eed95ad9da8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:54.040353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afac1-f0ef-4341-9b40-3eed95ad9da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:54.058566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a00afac1-f0ef-4341-9b40-3eed95ad9da8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:34:54.059787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a00afac1-f0ef-4341-9b40-3eed95ad9da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:34:54.115652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 741/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:34:54.270204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:34:54.271930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:34:54.345005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18257a72-e845-4a9b-9b9d-ca3689032b0c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:34:54.350631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:34:54.351916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:54.352209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:54.352491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:54.360490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:34:54.362079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711cb0-55f3-482e-a39e-06b8f5c51b44 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:34:54.371205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 773/1514] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:34:55.648320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda16-2be6-49bb-93d6-8bf5052d62eb None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:55.648853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda16-2be6-49bb-93d6-8bf5052d62eb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:55.648959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda16-2be6-49bb-93d6-8bf5052d62eb None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:55.650684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 742/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:34:55.655748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b55c6-df6f-49b2-905a-402a6c332db9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:55.656177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b55c6-df6f-49b2-905a-402a6c332db9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:55.656318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b55c6-df6f-49b2-905a-402a6c332db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:55.674714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3f8b55c6-df6f-49b2-905a-402a6c332db9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:34:55.675935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3f8b55c6-df6f-49b2-905a-402a6c332db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:34:55.684538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 774/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:34:55.834506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cda16-2be6-49bb-93d6-8bf5052d62eb None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:34:55.849032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cda16-2be6-49bb-93d6-8bf5052d62eb None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:34:55.855258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:34:55.855943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:34:55.856227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:34:55.856505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:34:55.864548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:34:55.866143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37147-c7bf-44ce-b670-36d8af9eca7c service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:34:55.875250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 743/1517] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:35:02.755797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434f89-2c52-4ab7-bdc9-7f1fc8603884 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:02.756264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434f89-2c52-4ab7-bdc9-7f1fc8603884 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:02.756371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434f89-2c52-4ab7-bdc9-7f1fc8603884 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:02.758114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 775/1518] 10.222.0.65 () {54 vars in 960 bytes} [Mon Feb 21 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:02.763667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee723ac-a675-40fa-9b5c-282f2dbae101 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:02.764117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee723ac-a675-40fa-9b5c-282f2dbae101 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:02.764225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee723ac-a675-40fa-9b5c-282f2dbae101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:02.782458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5ee723ac-a675-40fa-9b5c-282f2dbae101 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:02.783661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5ee723ac-a675-40fa-9b5c-282f2dbae101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:02.791854 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 744/1519] 10.222.0.65 () {58 vars in 1057 bytes} [Mon Feb 21 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:02.798975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434f89-2c52-4ab7-bdc9-7f1fc8603884 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:02.811836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434f89-2c52-4ab7-bdc9-7f1fc8603884 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:02.816684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:02.817297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:02.817582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:02.817859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:02.826360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:02.827980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83b31-0dea-45be-bf8b-3ac5ff2d30ee service placement] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:02.837228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 776/1520] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:35:07.548182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974ab2-4fba-444e-8883-d44fab288d66 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:07.548716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974ab2-4fba-444e-8883-d44fab288d66 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:07.548716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974ab2-4fba-444e-8883-d44fab288d66 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:07.550608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 745/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:07.555612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074888fb-3fe8-4ce7-96fa-33f0da6fd45a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:07.556043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074888fb-3fe8-4ce7-96fa-33f0da6fd45a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:07.556158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074888fb-3fe8-4ce7-96fa-33f0da6fd45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:07.574375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-074888fb-3fe8-4ce7-96fa-33f0da6fd45a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:07.575625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-074888fb-3fe8-4ce7-96fa-33f0da6fd45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:07.584088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 777/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:07.733504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974ab2-4fba-444e-8883-d44fab288d66 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:07.747768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974ab2-4fba-444e-8883-d44fab288d66 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:07.753663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:07.754296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:07.754584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:07.754864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:07.762820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:07.764430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e8903-7c5f-454f-9827-8789c3d552a4 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:07.774263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 746/1523] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:35:09.052910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfb93-33f6-44b5-8d5e-ce894f736162 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:09.053455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfb93-33f6-44b5-8d5e-ce894f736162 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:09.053455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfb93-33f6-44b5-8d5e-ce894f736162 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:09.055316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 778/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 09:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:09.060175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be887-06c6-4b84-99e4-88c63ca92eb7 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:09.060599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be887-06c6-4b84-99e4-88c63ca92eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:09.060716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98be887-06c6-4b84-99e4-88c63ca92eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:09.079999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f98be887-06c6-4b84-99e4-88c63ca92eb7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:09.081191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f98be887-06c6-4b84-99e4-88c63ca92eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:09.088962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 747/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 09:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:09.241535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfb93-33f6-44b5-8d5e-ce894f736162 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:09.256264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfb93-33f6-44b5-8d5e-ce894f736162 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:09.266181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:09.266181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:09.266181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:09.266181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:09.271692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:09.273289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b8129-0b75-4330-a507-2b9361bd2936 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:09.283061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 779/1526] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:35:13.980416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:13.980958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:13.980958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:13.982755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 748/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:13.988901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100424-9973-4d0c-9187-1e29a46ead41 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:13.989466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100424-9973-4d0c-9187-1e29a46ead41 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:13.989466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100424-9973-4d0c-9187-1e29a46ead41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:14.008550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ac100424-9973-4d0c-9187-1e29a46ead41 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:14.009758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ac100424-9973-4d0c-9187-1e29a46ead41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:14.017819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 780/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:14.054926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:14.056669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:14.111337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5ad77-4446-4ef1-a8d0-a7458864c285 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:14.114950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:14.115620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:14.115909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:14.116186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:14.125098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:14.127086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992e74-03d4-4c48-aa5c-6ad2f84d3204 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:14.136310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 749/1529] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:35:16.435916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:16.436454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:16.436454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:16.438223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 781/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:16.443569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8c7e-85e5-43d1-afb2-5d53aa2d6723 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:16.443996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8c7e-85e5-43d1-afb2-5d53aa2d6723 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:16.444140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c8c7e-85e5-43d1-afb2-5d53aa2d6723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:16.461881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-703c8c7e-85e5-43d1-afb2-5d53aa2d6723 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:16.463073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-703c8c7e-85e5-43d1-afb2-5d53aa2d6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:16.471405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 750/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:16.507610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:16.509313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:16.522439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ce37-0615-4333-abec-f689fc8b8ecd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:16.525976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:16.526617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:16.526880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:16.527151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:16.536019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:16.537431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001cc7-c2de-4b5b-90d2-3c56b9f2ac0c service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:16.546341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 782/1532] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:35:20.549260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:20.549772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:20.549772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:20.551621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 751/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:20.556785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79298141-ad8d-4852-9434-f2df367f9f31 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:20.560629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79298141-ad8d-4852-9434-f2df367f9f31 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:20.560629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79298141-ad8d-4852-9434-f2df367f9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:20.575629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-79298141-ad8d-4852-9434-f2df367f9f31 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:20.576807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-79298141-ad8d-4852-9434-f2df367f9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:20.585652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 783/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:20.834754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:20.836497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:20.891485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796dce1-7338-4ac6-a658-de0f7a18fb18 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:20.894984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:20.895642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:20.895928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:20.896204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:20.905000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:20.906427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c353-3f1b-44fc-8d9a-c07ca8e4752a service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:20.916126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 752/1535] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:35:23.240786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a40fc-9864-40d7-bf10-dae459a1a079 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:23.241383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a40fc-9864-40d7-bf10-dae459a1a079 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:23.241383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a40fc-9864-40d7-bf10-dae459a1a079 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:23.243249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 784/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 09:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:23.248556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a52f8-99f2-4f37-a78f-f9f9a1b51503 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:23.248997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a52f8-99f2-4f37-a78f-f9f9a1b51503 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:23.249146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a52f8-99f2-4f37-a78f-f9f9a1b51503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:23.267790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ba6a52f8-99f2-4f37-a78f-f9f9a1b51503 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:23.268982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ba6a52f8-99f2-4f37-a78f-f9f9a1b51503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:23.276797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 753/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:23.533900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcbfb2-9bc9-4478-adf3-c3be71599fbd None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:23.534101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcbfb2-9bc9-4478-adf3-c3be71599fbd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:23.534381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcbfb2-9bc9-4478-adf3-c3be71599fbd None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:23.536179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 785/1538] 10.222.0.65 () {54 vars in 963 bytes} [Mon Feb 21 09:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:35:23.540907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649cf1-9ccd-44c8-b447-ddb6c3e57980 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:23.541203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649cf1-9ccd-44c8-b447-ddb6c3e57980 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:23.541487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649cf1-9ccd-44c8-b447-ddb6c3e57980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:23.559353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c7649cf1-9ccd-44c8-b447-ddb6c3e57980 None None] MFA Rules not processed for user `8225ba8ede944425a2b21bb4eeb8ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:35:23.560534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c7649cf1-9ccd-44c8-b447-ddb6c3e57980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:35:23.567389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 754/1539] 10.222.0.65 () {58 vars in 1060 bytes} [Mon Feb 21 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:35:23.574766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcbfb2-9bc9-4478-adf3-c3be71599fbd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:35:23.586227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcbfb2-9bc9-4478-adf3-c3be71599fbd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:35:23.589768 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:35:23.590398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:35:23.590687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:35:23.590966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:35:23.600039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:35:23.601465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c61bbf-06ee-4bce-a0e2-6d9bf0436809 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:35:23.610720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 786/1540] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:49.610572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.611218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.611218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.638055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:49.639670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:49.648825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 755/1541] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:36:49.657065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.657641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.657641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.688394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:49.689647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:49.702707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 787/1542] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:49.706855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:49.719872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b06f5-3e07-486a-b65a-f1685af1a761 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:49.732790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:49.734154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.734663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.735157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.736136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:49.736757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:49.739268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15100049-c8e4-4680-9056-1d42882d602d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:49.753355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 756/1543] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:49.761697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:49.777168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482bdf-610a-43ef-85ed-8e7146c49352 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:49.785604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:49.786274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.786557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.786835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.787560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:49.789495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ecc4f-2c2d-4a12-8c7b-69409afb73ef admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:49.856130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271be40-c2b9-4736-afe0-775085a75331 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.856818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271be40-c2b9-4736-afe0-775085a75331 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.857321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271be40-c2b9-4736-afe0-775085a75331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.889319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9271be40-c2b9-4736-afe0-775085a75331 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:49.890517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9271be40-c2b9-4736-afe0-775085a75331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:49.905580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 757/1544] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:36:49.906938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.907234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.907549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.915450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 788/1545] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:49.916831 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5338dd-8145-49cc-86bf-39928f699fcd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:49.917283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5338dd-8145-49cc-86bf-39928f699fcd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:49.917570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5338dd-8145-49cc-86bf-39928f699fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:49.939140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:49.941500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:49.964393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ba5338dd-8145-49cc-86bf-39928f699fcd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:49.965903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ba5338dd-8145-49cc-86bf-39928f699fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.023508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 758/1546] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.024350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.058283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4325-a2b7-41d1-a719-2f145ab62404 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.082058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.082747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.083032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.083800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.084446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.086392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46f751-16c0-4920-b338-6b42cfa33ff4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.142479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 789/1547] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.144302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbe00-82be-4f8e-b838-9eb3ae5fb026 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.144738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbe00-82be-4f8e-b838-9eb3ae5fb026 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.144974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbe00-82be-4f8e-b838-9eb3ae5fb026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.181118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-078bbe00-82be-4f8e-b838-9eb3ae5fb026 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.190590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-078bbe00-82be-4f8e-b838-9eb3ae5fb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.199236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 759/1548] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/users => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:50.205739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.205739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.205739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.240202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 790/1549] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.241589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.241890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.242272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.246769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.248664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.274765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.276051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.289698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 760/1550] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.290586 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.293989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 791/1551] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.295415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.312068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c6130-604d-4e49-a479-57ab7e22c77d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.315026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd951-a7d8-4fa0-9dea-7945f214fc22 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.323503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.324178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.324566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.324843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.325577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.326256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.326944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.327183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.327315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.327522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.328255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:50.328571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.330571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.338274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 761/1552] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:50.339590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.351659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4993-8f8f-4645-8fc5-ec45db71bc45 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.356984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.358027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.358475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 792/1553] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:50.358985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.359187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.359791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.361423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:50.361966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.364401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4503d40-6793-44a5-9fd7-4af83520af63 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.376724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3b3a6-6382-4482-b99c-36a72d3a93a9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.381636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 762/1554] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:50.385210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.385210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.385210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.385881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.386731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.387039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.387400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.388078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:50.388404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.390128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.402856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 793/1555] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:50.403933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.404971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.406165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.414257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa1048-ea8e-4e17-b28d-7d094f13d5f5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.416079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 763/1556] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.416914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.422582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.423577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.424074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.424356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.425673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.427321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaeaa8-e681-47a2-8045-bc465e0a65af admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.429830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f007a19-1b51-432c-8d79-1509b7a78ae9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.435262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.436148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.436622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.437101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 794/1557] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:50.437353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.438313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5516-09dc-46de-8ac3-c777e84deac8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.438601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5516-09dc-46de-8ac3-c777e84deac8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.438877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5516-09dc-46de-8ac3-c777e84deac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.439112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.441443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.456965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-43db5516-09dc-46de-8ac3-c777e84deac8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.458499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43db5516-09dc-46de-8ac3-c777e84deac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.466913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 795/1558] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.468187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.468476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.468752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.486603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.489237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.496972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 796/1559] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.497708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.507235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ced8e7-9acf-4e62-a976-7485e2127736 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.512486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.513162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.513444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.513710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.514406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.516393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cde06-f30b-4c40-af20-dd395338605d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.571358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 764/1560] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:50.575344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.633566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9cfcb-be3f-4c28-9e05-3503af38afd7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.638123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.638774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.639058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.639368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.640057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.641966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec9582-ec35-4db1-b614-4f2dd8c86532 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.658983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 797/1561] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:50.658983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.658983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.658983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.675531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.680943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.732525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 798/1562] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.733298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.733728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 765/1563] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:50.734811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b83de-a064-441f-86f7-59c98ef90dde None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.735106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b83de-a064-441f-86f7-59c98ef90dde None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.735412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b83de-a064-441f-86f7-59c98ef90dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.742835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf62a-80ac-4e5f-b3fe-a7fecc987590 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.753412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-976b83de-a064-441f-86f7-59c98ef90dde None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.754600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-976b83de-a064-441f-86f7-59c98ef90dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.797486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.798403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.798692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.798988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] PATH_INFO: `/v3/projects/07141a2fde3a45b3915b22ba7814dd69/users/aa58ca65c6b84b6392b4fda3246bbfab/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.812101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 766/1564] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.813041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07141a2fde3a45b3915b22ba7814dd69, user_id=aa58ca65c6b84b6392b4fda3246bbfab, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.813532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2e8f-da68-46f5-98d6-b2522836835d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.813830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2e8f-da68-46f5-98d6-b2522836835d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.814108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e2e8f-da68-46f5-98d6-b2522836835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.816351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.831801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-786e2e8f-da68-46f5-98d6-b2522836835d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.833329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-786e2e8f-da68-46f5-98d6-b2522836835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.841167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 767/1565] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.842519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.842820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.843096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.867145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:50.870782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:50.879263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 768/1566] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:50.880180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.889717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e944-4738-4a63-b198-d0a480ef6a27 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.897020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.897020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.897020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.897020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.897441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.899440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:50.928968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 799/1567] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:50 2022] PUT /identity/v3/projects/07141a2fde3a45b3915b22ba7814dd69/users/aa58ca65c6b84b6392b4fda3246bbfab/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:50.929752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:50.989453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248651f5-6b32-4488-afc2-d6790e740c82 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:50.994432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:50.995126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:50.995446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:50.995728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:50.996431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:50.998397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.043387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 769/1568] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.044370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.055686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8016a65-f61e-46e9-9c7c-e43e8b267437 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.060247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.060882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.061168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.061443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.062115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.064066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228f10c-c162-4d5a-b504-54f1c30760c3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.163034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 800/1569] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:50 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.163963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.173378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cfeb7-415f-4e50-9ab0-1e22f615e2ee admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.174308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 770/1570] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.176443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.176730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.177006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.181365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.181970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.182258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.182541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.183345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:51.183662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.185379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.195954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:51.197170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:51.201892 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 801/1571] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:51.202745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.207160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 771/1572] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:51.208135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.213734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756a050-b1d6-4731-9425-f1e0b5fda7fb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.217722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b58d-f724-4ded-80d6-7128a24dda69 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.218575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.219226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.219548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.219826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.220553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:51.220881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.222448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb385-2ac8-4f81-a668-9722b544259a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.222648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.223327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.223616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.223980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.224674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:51.224984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.226571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.241188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 802/1573] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:51.241188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.241188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.241188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.241643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 772/1574] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:51.241643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.254167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd78a7-0159-404d-9044-c312f5167222 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.258665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.259339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.259626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.259904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.260679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.260805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:51.261918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:51.262266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.270315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 803/1575] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:51.271046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.277284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 773/1576] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.277284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.282316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bca7f-a098-460c-b279-3c5cfc555b8c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.285403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131ed7a-0e7f-4669-af06-10eab8be7098 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.287085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.287749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.288044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.288329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.289054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.290062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.290642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.290756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.291007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.291284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.292033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.293635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.300985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 804/1577] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.301838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.304277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 774/1578] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.305196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.311452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3ad0a-cb6b-4696-9062-64e642cc669c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.314564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236964d-1bd7-4a6e-a388-1c6e520515e6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.316592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.317225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.317513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.317793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.318498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:36:51.318806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.319947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.320402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.320609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.320881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.321155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.321831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.323728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.332247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 805/1579] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:36:51.333025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.343739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55379fb2-0672-40fe-ad51-16c687caa7a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.348920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.348920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.349202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.349482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.350161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.352076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.432735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 775/1580] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.433477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.455713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 806/1581] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.458016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.493080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b6bf6-8f57-4dab-91ec-e2545ecca614 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.516403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a86c9-e0db-49c7-9329-151e5b0efdf4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.521587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.522259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.522546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.522824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.523580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.525172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.535597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 807/1582] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.536388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.549335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.549996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.550279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.550555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.551236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.553188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.589860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76698-9c84-43de-8e98-1ed11297f9ba admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.593534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.594181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.594470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.594750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.604109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.609732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.614849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 808/1583] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:51.615733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.624725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8907-d102-4140-a8c8-99bb5fbdd394 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.629964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.630611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.630900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.631182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.632225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.633506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.637297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 776/1584] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.637297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.645894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 809/1585] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.645894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.655587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a46e4a-a06c-4423-a46d-5339aafd89a1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.699070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fedcf-9b72-491b-a984-9c17743fdd6c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.703833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.704584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.704869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.705153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.705873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.708221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.710298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.710954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.711248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.711560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.712248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.714202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.717916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 777/1586] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:51.718880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.728350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e284d-ff76-490b-a34b-ca5a1ed92b0c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.733181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.733844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.734134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.734415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.735147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.737195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.814429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 810/1587] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.814649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.843965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 778/1588] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.843965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.853736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8aca-da99-478f-9186-07ad7f305865 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.875803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55d26-5f34-4fa3-b766-f735b4ddff13 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.881114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.881784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.882066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.882340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.883022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.885076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.911386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.912381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.912673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.912959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] PATH_INFO: `/v3/projects/39ba98058ea84295b1cce52d3e792a29/users/d4d9ee91364a45d8b423814654f2acc5/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.928101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ba98058ea84295b1cce52d3e792a29, user_id=d4d9ee91364a45d8b423814654f2acc5, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.930788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:51.970946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 811/1589] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:51.970946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:51.978453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fa951-36d0-44f4-9902-f8e626ec5bdc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:51.983321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:51.983992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:51.984273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:51.984577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:51.985259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:51.987177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.036119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 779/1590] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:51 2022] PUT /identity/v3/projects/39ba98058ea84295b1cce52d3e792a29/users/d4d9ee91364a45d8b423814654f2acc5/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:52.036926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.076018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 812/1591] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:51 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:52.076394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.086096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe3659-9fa5-4acf-958e-f1393e864759 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.096733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cedd-77bf-414e-8c26-68b8b6f2d9d0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.102691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.103327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.103695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.103913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] PATH_INFO: `/v3/projects/6f97ed27bfc74d37afabc0df792afc42/users/0d6e4afb1882454c9ddedc3b14cf9cb1/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.119801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f97ed27bfc74d37afabc0df792afc42, user_id=0d6e4afb1882454c9ddedc3b14cf9cb1, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.122526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.143359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.144258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.144539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.144861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] PATH_INFO: `/v3/projects/13967438e5b14bd6a58c7e96f89079af/users/fefe07eadda04f749852deb6e6c5c7ed/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.159493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13967438e5b14bd6a58c7e96f89079af, user_id=fefe07eadda04f749852deb6e6c5c7ed, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.165423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.265929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 780/1592] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:52 2022] PUT /identity/v3/projects/6f97ed27bfc74d37afabc0df792afc42/users/0d6e4afb1882454c9ddedc3b14cf9cb1/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:52.268676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.327957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad36e8-1f82-4c9c-8800-3c351a2a2a1e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.328053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 813/1593] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:52 2022] PUT /identity/v3/projects/13967438e5b14bd6a58c7e96f89079af/users/fefe07eadda04f749852deb6e6c5c7ed/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:52.328563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.385594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.386379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.386750 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.387030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.387758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.389677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245739c-e496-435b-b0ea-170e8d4ad4f2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.390568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671af84-59a3-40b0-a2a3-56154b210126 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.395416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.396083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.396375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.396657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.397377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.398977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.408972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 814/1594] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.412524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.419283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ece5e-f493-45c4-b93c-ea10d0676cbb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.424511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.425710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.425999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.426271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.426958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.428534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13ceec-fd8d-4104-9009-a3dfd5b07385 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.437857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 815/1595] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.439037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.439352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.439635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.456711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:52.457901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:52.465700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 816/1596] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:52.466361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.479478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92da4-a04b-4566-85a6-cc4f2e99574d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.481995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 781/1597] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:52 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:52.483402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.483648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.483933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.485451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.486129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.486417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.486699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.488334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.490109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df90591-6566-467d-a9c1-0cac9f190419 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.502039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 817/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.502039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.502367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.504442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.504570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:52.505267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:52.513813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 782/1599] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:52.514860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.524963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe2f72-dbc5-4bc4-a594-c67de1da284f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.530095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.530840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.531199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.531710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.532450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.534065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.543326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] MFA Rules not processed for user `fefe07eadda04f749852deb6e6c5c7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:52.544653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:52.550004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 783/1600] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.550004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.559244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efca9-bfaf-4eda-8bb1-16d0a4329f08 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.564221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.564883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.566030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.566030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.566327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.567972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.584044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 784/1601] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.584044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.625971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 818/1602] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:52.626825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.640673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260f955-331f-4d14-83cc-dd6cfd51acdb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.645455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63743df6-e3b0-4648-a170-1804e5ac8d06 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.646169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.646857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.647209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.647618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.648351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.649422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.649988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.650224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.650519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.650802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.661046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 819/1603] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.661208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.661666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.662575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.671246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bd565-1683-41e6-b840-6352c58315bf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.677293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 785/1604] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:52.677293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.677478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.677478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.677478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.677478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.678105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.679459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.681712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bbb6-d4bb-4f2a-88c4-5b5d651a2be5 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.685906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.686530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.687216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.687216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.691371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 820/1605] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.691519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.701628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7dca5-2d75-414f-9eb3-cdb1d04f5a04 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.702697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.705556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.707047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.707961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.708252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.708535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] PATH_INFO: `/v3/projects/dc236ca35ec94a59b09b9073843559ae/users/c4a13bde51b04333aab56a463c91c378/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.714313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 786/1606] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:52.716410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.724066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc236ca35ec94a59b09b9073843559ae, user_id=c4a13bde51b04333aab56a463c91c378, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.726963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0bb7b-5955-46f7-aec0-b1e2fa727193 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.731917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7195-9209-467d-acd3-3ac481b9f785 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.745537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.745537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.745537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.745537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] PATH_INFO: `/v3/projects/d8b92d901fb840aa92cf7a6f0d2a637b/users/c7af92dd3af141dc81a674a1617e2596/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.755867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b92d901fb840aa92cf7a6f0d2a637b, user_id=c7af92dd3af141dc81a674a1617e2596, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.758827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.792957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 821/1607] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:52 2022] PUT /identity/v3/projects/dc236ca35ec94a59b09b9073843559ae/users/c4a13bde51b04333aab56a463c91c378/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:52.805050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41256b3-7fb6-451d-8522-e08f0c2dec5f None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.805334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41256b3-7fb6-451d-8522-e08f0c2dec5f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.805612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41256b3-7fb6-451d-8522-e08f0c2dec5f None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.807437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 822/1608] 10.222.0.65 () {54 vars in 961 bytes} [Mon Feb 21 09:36:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:36:52.812392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41256b3-7fb6-451d-8522-e08f0c2dec5f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.876785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 787/1609] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:52 2022] PUT /identity/v3/projects/d8b92d901fb840aa92cf7a6f0d2a637b/users/c7af92dd3af141dc81a674a1617e2596/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:52.876785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:52.879606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41256b3-7fb6-451d-8522-e08f0c2dec5f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.943801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467876d5-2404-4608-81a9-551f431ea2a7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:52.946721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.947466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.947904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.948215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.948554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:52.948943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.949444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.949732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.950012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] PATH_INFO: `/v3/projects/e05c08b255664381a966f688586fc635/users/cb6038deb5004b54ba8bf67a04babada/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.950579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101fe95-ca7a-4c5d-8c5a-3f6d28ed220e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.964671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 823/1610] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:52.964671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc142ad-7f63-4362-bf3e-ca84930ccbaa None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:52.964671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc142ad-7f63-4362-bf3e-ca84930ccbaa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:52.964671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc142ad-7f63-4362-bf3e-ca84930ccbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:52.966407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c08b255664381a966f688586fc635, user_id=cb6038deb5004b54ba8bf67a04babada, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:52.969107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e2bf1-3ba2-4d77-ad1d-9976828ea1dc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:52.993429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4fc142ad-7f63-4362-bf3e-ca84930ccbaa None None] MFA Rules not processed for user `c4a13bde51b04333aab56a463c91c378`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:52.994639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4fc142ad-7f63-4362-bf3e-ca84930ccbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.062637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 788/1611] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:52 2022] PUT /identity/v3/projects/e05c08b255664381a966f688586fc635/users/cb6038deb5004b54ba8bf67a04babada/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:53.062637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.062637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.062637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.078368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:53.079833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.094409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 824/1612] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.099350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88056a-ad67-4353-80de-b064177d6f4e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.099350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88056a-ad67-4353-80de-b064177d6f4e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.099350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88056a-ad67-4353-80de-b064177d6f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.143504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2d88056a-ad67-4353-80de-b064177d6f4e None None] MFA Rules not processed for user `c7af92dd3af141dc81a674a1617e2596`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:53.145920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2d88056a-ad67-4353-80de-b064177d6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.157968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 789/1613] 10.222.0.65 () {58 vars in 1058 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.159158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.232989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbd1c5-9658-49bc-b082-c19b6925b14d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.244209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.246129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.246736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.246736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] PATH_INFO: `/v3/projects/de0675c09376415bbbaab858235b8765/users/765e2a7f731c4facbb94fe8117e0053c/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.251690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 825/1614] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.252851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa121-5c34-4e1f-a0ba-528004fa384d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.253680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa121-5c34-4e1f-a0ba-528004fa384d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.255062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fa121-5c34-4e1f-a0ba-528004fa384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.269724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0675c09376415bbbaab858235b8765, user_id=765e2a7f731c4facbb94fe8117e0053c, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.270094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.275515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-cc8fa121-5c34-4e1f-a0ba-528004fa384d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:53.276708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cc8fa121-5c34-4e1f-a0ba-528004fa384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.288351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 826/1615] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.288351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.288351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.288351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.312997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] MFA Rules not processed for user `aa58ca65c6b84b6392b4fda3246bbfab`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:53.314269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.375009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 790/1616] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:53 2022] PUT /identity/v3/projects/de0675c09376415bbbaab858235b8765/users/765e2a7f731c4facbb94fe8117e0053c/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:53.378935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.389122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 827/1617] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.390084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.415818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098eec-8627-4c11-80e0-560461f15cc3 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.470449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb87457-4479-448a-acb3-311fb2ea80ec admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.476358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.476941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.477226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.483443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.483443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.483443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.522716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.523497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.523949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.524392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.564403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 791/1618] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:53.564403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.600553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.603685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.617642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 828/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:53.618332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.647582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584cb1-b06f-41d4-bfdf-9f368a03c3d2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.654038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.654994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.655553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.656039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.656924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.659166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.698390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49368fe-7776-489b-82e1-b627dfef00d6 service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.745979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.747447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.747988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.748471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.758319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.760099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75073587-166f-43b8-9bdb-ed7dd53bfa20 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.771634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 829/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:53.773218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.773790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.774278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.805415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 792/1621] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/projects => generated 403 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:53.806609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.815041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:53.819735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:53.878425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5795d-98e1-443d-ba82-a70c803c8af1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.883855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.884526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.884814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.885090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.885776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.887945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe6486-c8c4-4247-974f-e6ef863daca2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:53.915197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 830/1622] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:53.915197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:53.922621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f5d73-b455-4a19-9a65-f364e3e00b75 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:53.927314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:53.929453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:53.929772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:53.930083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:53.930782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:53.932838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.049560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 831/1623] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:54.049560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.049844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 793/1624] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:36:53 2022] POST /identity/v3/projects => generated 405 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:54.049844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718da62-6ea1-441c-9281-c3e5850e853d None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.049844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718da62-6ea1-441c-9281-c3e5850e853d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.049844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718da62-6ea1-441c-9281-c3e5850e853d None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.049844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 794/1625] 10.222.0.65 () {54 vars in 912 bytes} [Mon Feb 21 09:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:36:54.053385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718da62-6ea1-441c-9281-c3e5850e853d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.055911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c3de-b5be-4457-b260-34ced06e6a8c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.147133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718da62-6ea1-441c-9281-c3e5850e853d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.153197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.154541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.155222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.155548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.155961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.156668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.158596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13a8bb-a3a1-41bb-ba3e-ef8830bfc914 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.160456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.160750 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.161033 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.178100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.179650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.200509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 795/1626] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:54.203072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.224698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305058-45d6-4eed-a91c-d630447049a8 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.233590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.234690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.235889 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.239244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.239244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.239244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.249849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 796/1627] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:54.250751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.261281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297023-db5b-4199-a53e-366b81da46e3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.268853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.268853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.268853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.268853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.269261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.270261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.273158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 832/1628] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:54 2022] POST /identity/v3/users => generated 308 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:54.274154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.274611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.274897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.295775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:54.297598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:54.371097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 833/1629] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:54.372004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.383340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7c357-66b0-4743-a0e5-86ec1111a5a2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.387943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 797/1630] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:36:54 2022] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:36:54.388865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.391390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.392302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.392585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.392862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] PATH_INFO: `/v3/projects/2c682363997e485bbaed5d0fbb2af4f6/users/e735bb8e363844c7be1a2a2a41ea9c66/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.405285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa15292-d08e-4cc1-8122-196b24442ee5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.410710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c682363997e485bbaed5d0fbb2af4f6, user_id=e735bb8e363844c7be1a2a2a41ea9c66, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.413514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.413832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.416133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.416530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.417168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.419001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.421521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.447727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 798/1631] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:54.447727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.538659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 834/1632] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:54 2022] PUT /identity/v3/projects/2c682363997e485bbaed5d0fbb2af4f6/users/e735bb8e363844c7be1a2a2a41ea9c66/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:54.538659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.546665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f1575-fbd8-4332-ac55-4cf43447011a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.635780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78ffc0-23ce-49cf-9ff0-8aca278a9363 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.642414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.649398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.649398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.649639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.650092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.650186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.650288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.650376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.650376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.650538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.668350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 835/1633] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:54.669560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.681281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd98fce-3113-4ba8-a322-8a4f34be3cd3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.686912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.688322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.688760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.689198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] PATH_INFO: `/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91/users/6ca226861b444cff9f3b3bffb46065c0/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.753805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d95bc0877444f7fad00dd6dce9f8d91, user_id=6ca226861b444cff9f3b3bffb46065c0, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.756838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.786535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.786771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.798916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 799/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:54.803151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.811499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f8f96-9ac4-437d-a5b2-04da31757d60 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.817137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.817869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.818199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.818661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.819581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.821411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.832972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 800/1635] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:54.833924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.845419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf07add-b7a3-43c9-b754-4c2a69b1afba admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.855224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.855224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.855545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.855644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] PATH_INFO: `/v3/projects/13224f5a9222444c8e03cc98c9dd0acf/users/55d05c162d784b32948f4e0da0927003/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.875419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13224f5a9222444c8e03cc98c9dd0acf, user_id=55d05c162d784b32948f4e0da0927003, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.878701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 836/1636] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:54 2022] PUT /identity/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91/users/6ca226861b444cff9f3b3bffb46065c0/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:54.887446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.887615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.964213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03875eb7-5147-4704-894f-4f0a7d06a1be admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:54.969674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:54.970640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:54.970938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:54.971224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] PATH_INFO: `/v3/projects/2c682363997e485bbaed5d0fbb2af4f6/users/e735bb8e363844c7be1a2a2a41ea9c66/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:54.978421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c682363997e485bbaed5d0fbb2af4f6, user_id=e735bb8e363844c7be1a2a2a41ea9c66, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:54.978421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:54.978665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 801/1637] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:54 2022] PUT /identity/v3/projects/13224f5a9222444c8e03cc98c9dd0acf/users/55d05c162d784b32948f4e0da0927003/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:54.978665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:54.996910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 837/1638] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:54 2022] PUT /identity/v3/projects/2c682363997e485bbaed5d0fbb2af4f6/users/e735bb8e363844c7be1a2a2a41ea9c66/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:54.997224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:55.096832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359402-6bc1-4072-95d3-c727a80a2ac0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:55.155622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a4467-ed25-46c1-b645-9e06b00272e9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:55.175506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:55.176315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.176781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.177075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.178433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:55.180161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185ce6-98b2-4779-9632-86fac29ed21c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:55.206629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 838/1639] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:55.210809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:55.211532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.211830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.213058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.213412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.213872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.214954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.218428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:55.222528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:55.255775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 802/1640] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:36:55.258796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:55.284821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672410cd-d277-4cb4-9368-c30978deb653 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:55.295242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] MFA Rules not processed for user `e735bb8e363844c7be1a2a2a41ea9c66`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:55.298282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:55.300967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:55.302126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.302773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.303064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] PATH_INFO: `/v3/projects/13224f5a9222444c8e03cc98c9dd0acf/users/55d05c162d784b32948f4e0da0927003/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.308314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13224f5a9222444c8e03cc98c9dd0acf, user_id=55d05c162d784b32948f4e0da0927003, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:55.313922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:55.343631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 803/1641] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:55 2022] PUT /identity/v3/projects/13224f5a9222444c8e03cc98c9dd0acf/users/55d05c162d784b32948f4e0da0927003/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:55.344507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:55.461367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 839/1642] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:55.467194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:55.488288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94acc5-e642-4657-937c-87649607c4a1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:55.507363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:55.507781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.508078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.508820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] PATH_INFO: `/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91/users/6ca226861b444cff9f3b3bffb46065c0/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.531576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d95bc0877444f7fad00dd6dce9f8d91, user_id=6ca226861b444cff9f3b3bffb46065c0, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:55.535104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210670e4-ab20-492a-9055-66922afb72cb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:55.567520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 804/1643] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:36:55 2022] PUT /identity/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91/users/6ca226861b444cff9f3b3bffb46065c0/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:55.577403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.579509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.579509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.600419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30832831-748d-48d6-9c65-0421762f6b06 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:55.627369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] MFA Rules not processed for user `6ca226861b444cff9f3b3bffb46065c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:55.629289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:55.712450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:55.713410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:55.713890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:55.714346 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:55.781225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 805/1644] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:36:55.808601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:55.812038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abd47-e714-421a-b0c5-b52574b139f9 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:55.826669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 840/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:56.157485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:56.182452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7e690-28f5-44c4-a1bd-29cbe6a33c19 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:56.189158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:56.190025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.190347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.190642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.206439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:56.208288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a3d24-b8f3-41fa-826c-eb04d2814698 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:56.248270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe76a-779b-485a-8101-ca7132af0f33 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.249307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe76a-779b-485a-8101-ca7132af0f33 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.249826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fe76a-779b-485a-8101-ca7132af0f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.255016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 806/1646] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:56.325118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-583fe76a-779b-485a-8101-ca7132af0f33 None None] MFA Rules not processed for user `cb6038deb5004b54ba8bf67a04babada`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:56.326994 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-583fe76a-779b-485a-8101-ca7132af0f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:56.481426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 841/1647] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:56.493052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577696dd-85df-4982-a660-ca0bacf61662 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.493345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577696dd-85df-4982-a660-ca0bacf61662 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.493626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577696dd-85df-4982-a660-ca0bacf61662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.528413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-577696dd-85df-4982-a660-ca0bacf61662 None None] MFA Rules not processed for user `cb6038deb5004b54ba8bf67a04babada`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:56.529952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-577696dd-85df-4982-a660-ca0bacf61662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:56.552014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 807/1648] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:56.572387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3f7f9-fca5-4f87-96e3-6cb4d0e6acbe None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.572683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3f7f9-fca5-4f87-96e3-6cb4d0e6acbe None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.572959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3f7f9-fca5-4f87-96e3-6cb4d0e6acbe None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.575269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 842/1649] 10.222.0.65 () {54 vars in 961 bytes} [Mon Feb 21 09:36:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:36:56.593019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.593644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.594159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.635494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:56.636887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:56.836350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 808/1650] 10.222.0.65 () {58 vars in 1058 bytes} [Mon Feb 21 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:56.837100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3f7f9-fca5-4f87-96e3-6cb4d0e6acbe None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:56.861412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3f7f9-fca5-4f87-96e3-6cb4d0e6acbe None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:56.877803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:56.879122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:56.879540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:56.880141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:56.896066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:56.898077 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d683c7-4ae8-406f-aac1-2230db133d2b service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:56.924730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 843/1651] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:56.939437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:57.098500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b9716-ac2b-4228-884f-0cbb97302632 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:57.113195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] PATH_INFO: `/v3/users/c7af92dd3af141dc81a674a1617e2596` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7af92dd3af141dc81a674a1617e2596)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: WARNING py.warnings [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: warnings.warn(msg) Feb 21 09:36:57.118979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: Feb 21 09:36:57.119830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:57.359837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7af92dd3af141dc81a674a1617e2596'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:57.385398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7af92dd3af141dc81a674a1617e2596'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:57.402170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e97b-6e03-41d2-a93b-071ba326df4d None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.402602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e97b-6e03-41d2-a93b-071ba326df4d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.402978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e97b-6e03-41d2-a93b-071ba326df4d None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.405499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 844/1652] 10.222.0.65 () {54 vars in 912 bytes} [Mon Feb 21 09:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:36:57.412791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.415681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.415681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.435719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:57.437069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:57.452824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 845/1653] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:36:57.461647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:57.463395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:57.490106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7af92dd3af141dc81a674a1617e2596'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:57.490754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7af92dd3af141dc81a674a1617e2596'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:57.491413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca55cfe-fe32-425f-9798-ccec30468db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7af92dd3af141dc81a674a1617e2596'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:57.550545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 809/1654] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:36:56 2022] DELETE /identity/v3/users/c7af92dd3af141dc81a674a1617e2596 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:57.550545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.550545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.550545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.560837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999ee79-9f56-4982-b012-143c77db4329 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:57.607521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:57.607521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:57.650275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:57.651263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.651788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.652237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.657301 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:57.722600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 810/1655] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:57.736161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:57.738689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:57.818828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:57.820403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b137af-3ec6-4c26-a035-cbddc19d8cb8 service glance] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:57.857034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 846/1656] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:57.890677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddba4d-3cca-4a50-9823-90d2c5408ac5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:57.905842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:57.906896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:57.906896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:57.907090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:57.944098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:57.945906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f956ab-3385-4cf7-9e47-9c78f64d5e70 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:57.966460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 811/1657] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:58.777812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:58.778298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:58.778993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:58.781137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 847/1658] 10.222.0.65 () {54 vars in 912 bytes} [Mon Feb 21 09:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:36:58.788385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825427-e098-4464-ab85-87f8e1f7f392 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:58.788812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825427-e098-4464-ab85-87f8e1f7f392 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:58.789197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825427-e098-4464-ab85-87f8e1f7f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:58.835872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a8825427-e098-4464-ab85-87f8e1f7f392 None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:58.837437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a8825427-e098-4464-ab85-87f8e1f7f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:58.846275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 812/1659] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:36:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:59.003187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:59.003780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:59.004178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:59.004410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:59.008251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:59.027212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b11155-7562-4538-a134-382c5e5e8380 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:59.032642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:59.035119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:59.035584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:59.040635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:59.048469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:59.051577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:59.068500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 848/1660] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:36:59.090519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:59.094197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:59.124474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] MFA Rules not processed for user `55d05c162d784b32948f4e0da0927003`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:36:59.131010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f99bd-c863-4c2a-8ea7-3ccd9bbc944a service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:59.132965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:59.147047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:59.148061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:59.148415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:59.148763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] PATH_INFO: `/v3/projects/d8b92d901fb840aa92cf7a6f0d2a637b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:59.150866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b92d901fb840aa92cf7a6f0d2a637b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:59.155562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: WARNING py.warnings [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:36:59.155562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: warnings.warn(msg) Feb 21 09:36:59.155562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: Feb 21 09:36:59.156900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:59.258745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 813/1661] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:36:59.359661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b92d901fb840aa92cf7a6f0d2a637b', 'request_id': 'req-279a81d1-c12e-49bc-bf75-c0f4607733d1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.415248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b92d901fb840aa92cf7a6f0d2a637b', 'request_id': 'req-279a81d1-c12e-49bc-bf75-c0f4607733d1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.441901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b92d901fb840aa92cf7a6f0d2a637b', 'request_id': 'req-279a81d1-c12e-49bc-bf75-c0f4607733d1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.565458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] The token cache is being invalidate because project d8b92d901fb840aa92cf7a6f0d2a637b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:36:59.566134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.567793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.571359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 849/1662] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:36:59 2022] DELETE /identity/v3/projects/d8b92d901fb840aa92cf7a6f0d2a637b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:36:59.575154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:59.592690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813232-9fbb-49d9-ad0e-36a8961c75e2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:59.671994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:59.674423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:59.683470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:59.685884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] PATH_INFO: `/v3/users/6ca226861b444cff9f3b3bffb46065c0` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:59.687957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca226861b444cff9f3b3bffb46065c0)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:59.689908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:59.846473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:36:59.849373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:36:59.878695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca226861b444cff9f3b3bffb46065c0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.882190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81d1-c12e-49bc-bf75-c0f4607733d1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:36:59.887911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca226861b444cff9f3b3bffb46065c0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.895649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:36:59.896688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:36:59.902321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:36:59.902321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] PATH_INFO: `/v3/users/fefe07eadda04f749852deb6e6c5c7ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:36:59.902321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefe07eadda04f749852deb6e6c5c7ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:36:59.907411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:36:59.975651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca226861b444cff9f3b3bffb46065c0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.976621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca226861b444cff9f3b3bffb46065c0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:36:59.983329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6fcddc1f-368e-41f8-8938-855a6a435a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca226861b444cff9f3b3bffb46065c0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.015533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 814/1663] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:36:59 2022] DELETE /identity/v3/users/6ca226861b444cff9f3b3bffb46065c0 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:00.122583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e04f3-0e3d-4042-b861-39cdbf33a832 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:00.122862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e04f3-0e3d-4042-b861-39cdbf33a832 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:00.123150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e04f3-0e3d-4042-b861-39cdbf33a832 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:00.129204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 815/1664] 10.222.0.65 () {54 vars in 960 bytes} [Mon Feb 21 09:37:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:37:00.144037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:00.144349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:00.144637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:00.193563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] MFA Rules not processed for user `50283131637940ae9445c1800a8abb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:00.195019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:00.224000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefe07eadda04f749852deb6e6c5c7ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.242403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefe07eadda04f749852deb6e6c5c7ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.333607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 816/1665] 10.222.0.65 () {58 vars in 1057 bytes} [Mon Feb 21 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:00.345847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefe07eadda04f749852deb6e6c5c7ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.347144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefe07eadda04f749852deb6e6c5c7ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.347862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3e1e4a71-cb0f-4e70-b710-de1d97f09875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefe07eadda04f749852deb6e6c5c7ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:00.358859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:00.383852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65a3b1-4730-432a-908c-f642e5f74582 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:00.387203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 850/1666] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:36:59 2022] DELETE /identity/v3/users/fefe07eadda04f749852deb6e6c5c7ed => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:00.388983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:00.390203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:00.391087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:00.429226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:00.434404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:00.560942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:00.562245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:00.562537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:00.562824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:00.568210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:00.600760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 851/1667] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:00.610077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:00.611772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:00.655749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 817/1668] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:01.018151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:01.018151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:01.018151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa41d-3876-484d-a527-23e8601a5fae None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:01.021503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:01.021503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:01.021503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:01.021503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:01.022331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:01.022331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bf29e-babf-4de0-b61d-2ba897ad9666 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:01.022331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 852/1669] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:02.053074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:02.055284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:02.081926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c03ad-effe-4d11-b412-eaa1b93f3a64 service placement] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:02.098704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:02.099710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:02.100000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:02.100279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] PATH_INFO: `/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:02.102386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d95bc0877444f7fad00dd6dce9f8d91)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:02.104380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:02.336283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d95bc0877444f7fad00dd6dce9f8d91', 'request_id': 'req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.361067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d95bc0877444f7fad00dd6dce9f8d91', 'request_id': 'req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.382251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d95bc0877444f7fad00dd6dce9f8d91', 'request_id': 'req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.486052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] The token cache is being invalidate because project 5d95bc0877444f7fad00dd6dce9f8d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:02.486351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.487097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e3feb362-6ff7-4209-ae0a-0a5a2cf6e56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.489995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 818/1670] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:02 2022] DELETE /identity/v3/projects/5d95bc0877444f7fad00dd6dce9f8d91 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:02.495542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:02.496044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:02.496127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:02.559733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:02.559733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:02.673223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 853/1671] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:02.681184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:02.681685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:02.682104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:02.709245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:02.710708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:02.733990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb9a4d-363d-4714-a57b-2a442ffde65d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:02.735069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:02.739838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:02.743429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:02.743429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:02.744066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:02.744371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] PATH_INFO: `/v3/projects/13967438e5b14bd6a58c7e96f89079af` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:02.747862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=13967438e5b14bd6a58c7e96f89079af)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:02.749899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:02.774132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 819/1672] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:02.777760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:02.807004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6389-524b-4b9a-b862-f24c3afb5e96 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:02.816474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:02.817418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:02.818625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:02.819138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:02.820740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:02.821043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:02.823595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:02.884435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 820/1673] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:37:02.889174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:02.906791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae83a4-4610-48a6-b002-318df73696fa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:02.907562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13967438e5b14bd6a58c7e96f89079af', 'request_id': 'req-72ad9f50-f186-4a10-8f75-6bfda8764afd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.932640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13967438e5b14bd6a58c7e96f89079af', 'request_id': 'req-72ad9f50-f186-4a10-8f75-6bfda8764afd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:02.953705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13967438e5b14bd6a58c7e96f89079af', 'request_id': 'req-72ad9f50-f186-4a10-8f75-6bfda8764afd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:03.025462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] The token cache is being invalidate because project 13967438e5b14bd6a58c7e96f89079af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:03.027562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:03.031544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-72ad9f50-f186-4a10-8f75-6bfda8764afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:03.039339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 854/1674] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:02 2022] DELETE /identity/v3/projects/13967438e5b14bd6a58c7e96f89079af => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:03.041343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26d80-235d-4554-9023-d48bab7b6328 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.041759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26d80-235d-4554-9023-d48bab7b6328 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.042219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26d80-235d-4554-9023-d48bab7b6328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.045768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.046695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.051381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.051381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.051381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.054421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.100388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-bfb26d80-235d-4554-9023-d48bab7b6328 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:03.105366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-bfb26d80-235d-4554-9023-d48bab7b6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:03.131664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 855/1675] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:03.133760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.135258 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.136441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.179059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:03.183082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:03.184295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 821/1676] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:02 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:03.187947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.192041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:03.340243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 856/1677] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:03.341368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.353093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2a54-693d-4744-9648-0791ab70fbfe None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.363356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef07ff-271b-4f62-8534-27b568fc058c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.369521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.371367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.373221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.373620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.375083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:03.375083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.376034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.376741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.377028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.377314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.378063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.379829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.384739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.404392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 857/1678] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:03.410237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.426622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc7b02-74ed-470e-8b77-820c766778a6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.432716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.433825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.434609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.434609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.435467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.437491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.515561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 822/1679] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:03 2022] POST /identity/v3/users => generated 286 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:03.519268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.537008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dec873-e15d-49b5-9d92-bf3e1dd08a38 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.548701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.549395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.550397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.550688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.551453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.555913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.570983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 858/1680] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:03 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:03.572139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.580605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 823/1681] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:03.586901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.609385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4c23-5e71-4c58-9f58-c92cc02fd95e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.712190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.713315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.713615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.713895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.714638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.717953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.743250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 824/1682] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:03.744220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.748799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:03.750438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed706-a976-4661-915c-030bf0d4c1e3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.765151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.765602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.765888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.766169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.766874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:03.769961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:03.883353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 859/1683] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:03 2022] POST /identity/v3/users => generated 279 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:03.883353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:03.885403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631d0e7-9438-4d37-b3ac-d45a6cc764e7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.901713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.902384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.902672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.902951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:03.915021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:03.920309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278a41-9302-44ba-a37f-edd99e416e2b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:03.948141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:03.949499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:03.954898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:03.954898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] PATH_INFO: `/v3/projects/73ad18cfbba84d81b958da5528b6951f/users/be6b095718684cda8db2861f560318b4/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.013480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ad18cfbba84d81b958da5528b6951f, user_id=be6b095718684cda8db2861f560318b4, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.021545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74da9-1e1e-400c-9e4e-e939628639cb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.070182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.072566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.093999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 825/1684] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:04.095678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:04.113845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d58a60-fb79-4105-8160-93cf762ed578 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:04.124898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:04.125991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.127010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.127469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.128515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.131334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.144399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 860/1685] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:03 2022] PUT /identity/v3/projects/73ad18cfbba84d81b958da5528b6951f/users/be6b095718684cda8db2861f560318b4/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:04.146519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.146918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.147316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.162813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 826/1686] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:04.170954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:04.186359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fab58-80c4-4162-94d0-e875dce4009b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:04.201922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] MFA Rules not processed for user `be6b095718684cda8db2861f560318b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:04.203384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:04.461929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:04.462628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.462915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.463196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.464026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.473326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.497227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 861/1687] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:04.498153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:04.505927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:04.507780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 827/1688] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:04.509083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:04.530713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fc3c7-42ff-4b06-a5d7-949aa147dbfc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:04.534726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c5009-1ea0-4dfe-a622-486f9b56f1be None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:04.542298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:04.544283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.544721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.546079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:04.547099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.547583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.548000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.549522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.552762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.553845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] PATH_INFO: `/v3/users/aa58ca65c6b84b6392b4fda3246bbfab` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.559619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa58ca65c6b84b6392b4fda3246bbfab)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.563654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.726952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 828/1689] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:04 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:04.727924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:04.840803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa58ca65c6b84b6392b4fda3246bbfab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:04.853861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa58ca65c6b84b6392b4fda3246bbfab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:04.864680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac0f7-f84c-4f50-8a0b-fbd83c38bac8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:04.872673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:04.874476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:04.874780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:04.875118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] PATH_INFO: `/v3/projects/a36ef3a6427d4cb1ab1d45142eb34588/users/cf24f8f3e06c43608bbf1774e8f26b35/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:04.936360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36ef3a6427d4cb1ab1d45142eb34588, user_id=cf24f8f3e06c43608bbf1774e8f26b35, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:04.939800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95077e-57e4-4abf-8b5f-ab6b838831eb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:04.951970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa58ca65c6b84b6392b4fda3246bbfab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:04.952931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa58ca65c6b84b6392b4fda3246bbfab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:04.958791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa58ca65c6b84b6392b4fda3246bbfab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:05.042566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 862/1690] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:04 2022] DELETE /identity/v3/users/aa58ca65c6b84b6392b4fda3246bbfab => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:05.042660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 829/1691] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:04 2022] PUT /identity/v3/projects/a36ef3a6427d4cb1ab1d45142eb34588/users/cf24f8f3e06c43608bbf1774e8f26b35/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:05.042741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:05.044395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:05.044770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.045191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.045614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.114872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] MFA Rules not processed for user `cf24f8f3e06c43608bbf1774e8f26b35`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:05.116243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:05.256225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8130ff-7691-4c56-b39b-d3dacb181274 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:05.301371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 830/1692] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:05.302672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:05.304451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:05.412174 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:05.412897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.413169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.413447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.414153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:05.422131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:05.466623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9eaa4-d378-4874-938c-64c445fdaa00 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:05.497165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:05.497535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.498048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.498329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.499141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:05.502463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b235836-21eb-4f2b-9756-d8cc39e722ab admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:05.584943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 863/1693] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:05 2022] POST /identity/v3/users => generated 293 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:05.593428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:05.632022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afd607-7f35-473d-9512-f487730f9e95 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:05.668704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:05.668704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.668704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.668704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.669471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:05.671525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:05.695447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 864/1694] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:05.703359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:05.715640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 831/1695] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:05 2022] POST /identity/v3/projects => generated 355 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:05.730617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd3e36-974a-4d07-9ed8-0d4cf69c0043 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:05.731182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.732723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.734122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.821862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] MFA Rules not processed for user `0d6e4afb1882454c9ddedc3b14cf9cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:05.835255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:05.884806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:05.889009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:05.889469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:05.890042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] PATH_INFO: `/v3/projects/dafa8a45ba9e45dea05683ed180ff64d/users/1827d96381d94a0294f2b9e19f5a33e2/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:05.930742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafa8a45ba9e45dea05683ed180ff64d, user_id=1827d96381d94a0294f2b9e19f5a33e2, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:05.934103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9c8b8-d6ec-4ed3-bbcb-e66343175976 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:05.979126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 832/1696] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:05.980139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.019447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba212f4-3f5b-47fb-a157-4557630cb2a0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.037392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.038327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.039073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.039482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.040304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:06.042358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 865/1697] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:05 2022] PUT /identity/v3/projects/dafa8a45ba9e45dea05683ed180ff64d/users/1827d96381d94a0294f2b9e19f5a33e2/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:06.043826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.044118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.044522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.049878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:06.080410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] MFA Rules not processed for user `0d6e4afb1882454c9ddedc3b14cf9cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:06.081700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:06.172114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 833/1698] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:05 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:06.172114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.193202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27a24a-89d4-4c14-8f76-75e70191247c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.231101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 866/1699] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:06.237151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.238739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:06.349897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.350768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.351194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.351644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.352550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:06.354323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:06.396002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 834/1700] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:06.397064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.420773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbf2b0-f839-4c21-9638-0b111227d783 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.427226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf879e-bad6-42d4-8498-4b4f6067311c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.432467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.433270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.433564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.433844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.434687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:06.436395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:06.440921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.446169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.446617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.447026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] PATH_INFO: `/v3/projects/07141a2fde3a45b3915b22ba7814dd69` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.449549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07141a2fde3a45b3915b22ba7814dd69)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:06.453937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:06.464722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 835/1701] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:06.467135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.468981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:06.649443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07141a2fde3a45b3915b22ba7814dd69', 'request_id': 'req-6050765e-ab3a-42c6-91a0-3a6a216e7d41'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:06.655856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df6a36-ce51-4a59-bd84-5b17325546b1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.663955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07141a2fde3a45b3915b22ba7814dd69', 'request_id': 'req-6050765e-ab3a-42c6-91a0-3a6a216e7d41'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:06.672589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07141a2fde3a45b3915b22ba7814dd69', 'request_id': 'req-6050765e-ab3a-42c6-91a0-3a6a216e7d41'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:06.805054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] The token cache is being invalidate because project 07141a2fde3a45b3915b22ba7814dd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:06.805369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:06.806077 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:06.812519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 867/1702] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:06 2022] DELETE /identity/v3/projects/07141a2fde3a45b3915b22ba7814dd69 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:06.819878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.822600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:06.853305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.853977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:06.854259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:06.854543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:06.858226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:06.973959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:06.975129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050765e-ab3a-42c6-91a0-3a6a216e7d41 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:06.978050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:06.987618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:06.989752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 836/1703] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:06.990650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:06.991995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.000960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.001308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.001488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] PATH_INFO: `/v3/projects/dafa8a45ba9e45dea05683ed180ff64d/users/1827d96381d94a0294f2b9e19f5a33e2/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.007193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a61c-cd5f-42b4-bff0-0de5a9db2324 service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:07.010727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafa8a45ba9e45dea05683ed180ff64d, user_id=1827d96381d94a0294f2b9e19f5a33e2, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:07.012629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:07.013866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.014155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.014436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] PATH_INFO: `/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4/users/e3d9719326d04ee68e61bca170294f25/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.022097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:07.038519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad15e20fb6640ddb1f11f4f045cb6b4, user_id=e3d9719326d04ee68e61bca170294f25, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:07.043325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86687e1-fc4c-42e6-b696-86ca68c08d94 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:07.071476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 868/1704] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:06 2022] PUT /identity/v3/projects/dafa8a45ba9e45dea05683ed180ff64d/users/1827d96381d94a0294f2b9e19f5a33e2/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:07.071476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:07.076388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.170581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 837/1705] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:06 2022] PUT /identity/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4/users/e3d9719326d04ee68e61bca170294f25/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:07.177918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2a58b-68a6-4029-8cff-511ef1794b6e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.180849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2a58b-68a6-4029-8cff-511ef1794b6e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.181371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2a58b-68a6-4029-8cff-511ef1794b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.216844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adccdc-47f3-49ea-8b77-47fec79eb267 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:07.267934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-97c2a58b-68a6-4029-8cff-511ef1794b6e None None] MFA Rules not processed for user `765e2a7f731c4facbb94fe8117e0053c`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:07.270868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-97c2a58b-68a6-4029-8cff-511ef1794b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.387614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:07.387614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.387614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.387614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] PATH_INFO: `/v3/users/55d05c162d784b32948f4e0da0927003` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.388743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d05c162d784b32948f4e0da0927003)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:07.390548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:07.420400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 838/1706] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:07.427177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.430908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.431335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.481373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] MFA Rules not processed for user `1827d96381d94a0294f2b9e19f5a33e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:07.482795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.593185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 839/1707] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:07.594435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:07.606453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a58f09-6b48-499f-a232-fd2ffd0d2a06 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:07.615818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:07.623065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.623065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.623065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.623065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:07.623065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:07.636456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 840/1708] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:07.637610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:07.639743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.699903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d05c162d784b32948f4e0da0927003'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:07.714694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d05c162d784b32948f4e0da0927003'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:07.759262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac320e-3ad1-43b4-9f78-e343af4a9751 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:07.767388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:07.768351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:07.768681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:07.769484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:07.779718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:07.781589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:07.791613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 841/1709] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:07.792427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:07.793968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.814319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d05c162d784b32948f4e0da0927003'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:07.814968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d05c162d784b32948f4e0da0927003'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:07.816865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d05c162d784b32948f4e0da0927003'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:07.860222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 869/1710] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:07 2022] DELETE /identity/v3/users/55d05c162d784b32948f4e0da0927003 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:07.861165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:07.863241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:07.923727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2e68-79c2-47e5-a3e9-c5f4ff317588 service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:08.000687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f651c-b0d8-4b93-8676-a572227a09e4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:08.006764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:08.008026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.008510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.008952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] PATH_INFO: `/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4/users/e3d9719326d04ee68e61bca170294f25/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.016295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad15e20fb6640ddb1f11f4f045cb6b4, user_id=e3d9719326d04ee68e61bca170294f25, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:08.021217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37fe7f-b179-4f74-bec5-abc8e837e3a2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:08.042590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:08.043259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.043578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.043858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.046292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.061118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 870/1711] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:07 2022] PUT /identity/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4/users/e3d9719326d04ee68e61bca170294f25/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:08.062836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.063746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.066606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.128342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:08.130490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] MFA Rules not processed for user `d4d9ee91364a45d8b423814654f2acc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:08.131086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b64cf-da28-4cbd-9a34-07571b7a54d1 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:08.133907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.143534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 842/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:08.146017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.146526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.147328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.187974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] MFA Rules not processed for user `e3d9719326d04ee68e61bca170294f25`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:08.189884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.314420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 843/1713] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:08.319824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 871/1714] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:08.376926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:08.378337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.472830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:08.474840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.519844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad14a8-1f2e-49ca-b9fd-ad092dc57493 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:08.551124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:08.551964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.553974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.554347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.582171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:08.584766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8de56-5ff2-43f8-b6fe-60ecd92dd8f6 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:08.585021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f863a21-1a8a-4a61-8c84-1562dee1aaea None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:08.595795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:08.596681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.597032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.597375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.600547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.609926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 844/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:08.614701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699884-09d4-4804-9836-d7453179be56 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.615077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699884-09d4-4804-9836-d7453179be56 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.615529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699884-09d4-4804-9836-d7453179be56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.660225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fe699884-09d4-4804-9836-d7453179be56 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:08.662720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fe699884-09d4-4804-9836-d7453179be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.776753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:08.779261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:08.805099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 872/1716] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:08.806221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:08.810072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.820595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 845/1717] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:08.821490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699884-09d4-4804-9836-d7453179be56 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:08.835590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fe699884-09d4-4804-9836-d7453179be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:08.979666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac4790-5e55-4382-b6b5-9ff54287a6f3 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:08.987662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:08.988553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:08.988961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:08.989343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:08.999021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:09.000896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af785b7-869b-4149-ab24-42d6cf815e84 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:09.013450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 873/1718] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:09.015701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.016094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.017067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.017182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699884-09d4-4804-9836-d7453179be56 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:09.022266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:09.023907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.023907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.024237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] PATH_INFO: `/v3/projects/13224f5a9222444c8e03cc98c9dd0acf` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.025660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13224f5a9222444c8e03cc98c9dd0acf)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:09.028040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:09.078119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] MFA Rules not processed for user `0d6e4afb1882454c9ddedc3b14cf9cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:09.083627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.169549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 874/1719] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:09.169549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:09.179123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08511-9894-4ae0-ab09-15bd24ad4356 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:09.184292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:09.185792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.186190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.186574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.188677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.224890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13224f5a9222444c8e03cc98c9dd0acf', 'request_id': 'req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:09.238563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13224f5a9222444c8e03cc98c9dd0acf', 'request_id': 'req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:09.268855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13224f5a9222444c8e03cc98c9dd0acf', 'request_id': 'req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:09.287390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:09.289124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:09.319074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 875/1720] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:09 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:09.374795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:09.378021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.422805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] The token cache is being invalidate because project 13224f5a9222444c8e03cc98c9dd0acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:09.423439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:09.424157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6d05be81-4010-493a-ae0e-a3d5e0cd7a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:09.426689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 846/1721] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:08 2022] DELETE /identity/v3/projects/13224f5a9222444c8e03cc98c9dd0acf => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:09.431754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3ba8-881d-41ab-bd90-06b3d9641cdd None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.432048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3ba8-881d-41ab-bd90-06b3d9641cdd None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.432332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3ba8-881d-41ab-bd90-06b3d9641cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.524792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-47bc3ba8-881d-41ab-bd90-06b3d9641cdd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:09.526196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-47bc3ba8-881d-41ab-bd90-06b3d9641cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.860299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747c91-f3d3-4977-80da-539dc03c6a46 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:09.860299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:09.860299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.860299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.861152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.861152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 847/1722] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f35-42d2-4729-85cb-536e01414656 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f35-42d2-4729-85cb-536e01414656 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f35-42d2-4729-85cb-536e01414656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-68949f35-42d2-4729-85cb-536e01414656 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:09.861410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-68949f35-42d2-4729-85cb-536e01414656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:09.879731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 848/1723] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:09.881262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68949f35-42d2-4729-85cb-536e01414656 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:09.898086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68949f35-42d2-4729-85cb-536e01414656 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:09.904181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:09.905071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:09.905700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:09.906054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:09.907830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:09.908341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:09.910965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:09.914930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:09.916716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:09.954391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 849/1724] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:09.959067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:09.976352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 876/1725] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:37:09.993272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53c94c-b292-4ff2-a14a-ecb616cf7f1a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:10.050869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:10.054823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.061871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.061871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.069387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:10.095630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6870-2b42-4b9f-bdb4-c789643b3670 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:10.260811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 850/1726] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:09 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:10.263007 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:10.299064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714ad24-5735-4302-824b-a8af1db9903a service swift] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:10.587326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:10.589203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.590102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.591737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.593781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:10.604454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:10.729182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5c38-e6b3-4ba7-8403-a0f26dceac44 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.732652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 877/1727] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:10 2022] POST /identity/v3/users => generated 293 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:10.732836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5c38-e6b3-4ba7-8403-a0f26dceac44 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.733146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5c38-e6b3-4ba7-8403-a0f26dceac44 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.733835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:10.736059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 851/1728] 10.222.0.65 () {54 vars in 912 bytes} [Mon Feb 21 09:37:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:37:10.741838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fb90-104e-4241-916b-387135a6a988 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.746000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fb90-104e-4241-916b-387135a6a988 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.746000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fb90-104e-4241-916b-387135a6a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.782657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707b025-f464-4d08-983f-79906f16dca6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:10.801279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:10.804165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.805294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.807817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.810924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:10.813312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b404fb90-104e-4241-916b-387135a6a988 None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:10.816043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:10.822054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b404fb90-104e-4241-916b-387135a6a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:10.932774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 878/1729] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:10.933897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:10.965810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbd83-bcf5-4234-8a5a-85de49a6dc72 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:10.984568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:10.985315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:10.985599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:10.985877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:10.986612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:11.002516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:11.043358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 879/1730] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:11.047288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:11.053348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 852/1731] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:11.092486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be9d6-bb85-4dd0-8a98-a9e5aec12fbb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:11.111758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:11.113244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:11.113577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:11.113798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] PATH_INFO: `/v3/projects/505cdf9a7c1a4e2881bce6dc4a591ae3/users/bfbc24456ea644a3afa9fe026d006502/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:11.165514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fb90-104e-4241-916b-387135a6a988 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:11.167057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b404fb90-104e-4241-916b-387135a6a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:11.182820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] RBAC: Authorizing `identity:create_grant(project_id=505cdf9a7c1a4e2881bce6dc4a591ae3, user_id=bfbc24456ea644a3afa9fe026d006502, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:11.185907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:11.187359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fb90-104e-4241-916b-387135a6a988 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:11.199456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:11.200287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:11.201533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:11.201954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:11.237786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:11.239647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dedd24-fcca-4da7-a16b-a9f473a90b72 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:11.249371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 853/1732] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:11.326220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 880/1733] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:11 2022] PUT /identity/v3/projects/505cdf9a7c1a4e2881bce6dc4a591ae3/users/bfbc24456ea644a3afa9fe026d006502/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:11.328450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:11.329227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:11.329805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:11.392060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] MFA Rules not processed for user `bfbc24456ea644a3afa9fe026d006502`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:11.396940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:11.561375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 854/1734] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:11.567004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:11.683908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573fa0b-aa5b-43d4-a226-b6dda91a181b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:11.691763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:11.692839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:11.693286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:11.693849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:11.694766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:11.697445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:11.863056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:11.864996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 881/1735] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:11 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:11.883163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cda8cc-e3f7-414f-a2ef-be6edb66a65c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:12.058124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:12.062062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.067494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.072911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.072911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:12.074834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b40d8-b20a-4ba7-99eb-31c694244de6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:12.215795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 855/1736] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:11 2022] POST /identity/v3/users => generated 300 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:12.220398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:12.266649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a6e58-0594-4e6d-93ea-2359590cc5d2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:12.314612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:12.314612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.314612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.314612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.321432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:12.327864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:12.332819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.333798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.334249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.392586 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:12.394754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:12.408012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 882/1737] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:12.410228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:12.463111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b1ddd-5dc9-4b20-a817-057c61bbf279 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:12.489496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:12.490592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.490741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.493798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] PATH_INFO: `/v3/projects/27d3185561cc4f109b017a9e0f2d4427/users/ae032f74272f4756a59cab1611d30d85/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.572314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3185561cc4f109b017a9e0f2d4427, user_id=ae032f74272f4756a59cab1611d30d85, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:12.575313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:12.616657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 856/1738] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Feb 21 09:37:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:12.640465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:12.661923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d765-d54d-47c7-b455-b57b4227759d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:12.673250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:12.675851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.676428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.678121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.704853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:12.710144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:12.724443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 857/1739] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:12.757194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 883/1740] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:12 2022] PUT /identity/v3/projects/27d3185561cc4f109b017a9e0f2d4427/users/ae032f74272f4756a59cab1611d30d85/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:12.761197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:12.786085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51536ad7-5ca5-4421-9b25-88fe184c4110 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:12.939716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:12.947781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:12.955983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:12.955983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:12.955983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:12.955983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f267c8-4568-4eb7-ac5f-40426532f2f2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:12.974621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:12.977573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 858/1741] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:12.995827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ca81a-17df-4fc9-9161-7b3dfd79a7f8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:13.010380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:13.019096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:13.019096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:13.019096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] PATH_INFO: `/v3/projects/27d3185561cc4f109b017a9e0f2d4427/users/ae032f74272f4756a59cab1611d30d85/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:13.024619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3185561cc4f109b017a9e0f2d4427, user_id=ae032f74272f4756a59cab1611d30d85, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:13.036759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:13.115032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 884/1742] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:12 2022] PUT /identity/v3/projects/27d3185561cc4f109b017a9e0f2d4427/users/ae032f74272f4756a59cab1611d30d85/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:13.125775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:13.126670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:13.126670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:13.219822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] MFA Rules not processed for user `ae032f74272f4756a59cab1611d30d85`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:13.219822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:13.510087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 859/1743] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:13.517447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:13.520622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:13.733524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2017b3-d467-412a-bec8-1b606e5c0d5a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:13.743533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:13.744475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:13.745626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:13.746475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:13.782349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:13.786406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccf0c4-7dd2-4cce-8976-1a416aadf330 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:13.807118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 885/1744] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:13.958004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:14.110390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471a758-7977-4017-8afe-70487d0c0178 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:14.122560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:14.126441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:14.127399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:14.130539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] PATH_INFO: `/v3/users/bfbc24456ea644a3afa9fe026d006502` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:14.134762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbc24456ea644a3afa9fe026d006502)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:14.138388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:14.471508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbc24456ea644a3afa9fe026d006502'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:14.480787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbc24456ea644a3afa9fe026d006502'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:14.573365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbc24456ea644a3afa9fe026d006502'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:14.574098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbc24456ea644a3afa9fe026d006502'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:14.574771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbc24456ea644a3afa9fe026d006502'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:14.602652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 860/1745] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:13 2022] DELETE /identity/v3/users/bfbc24456ea644a3afa9fe026d006502 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:14.606988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83133f-2214-4c29-92b7-07750e4fe6da None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:14.607652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83133f-2214-4c29-92b7-07750e4fe6da None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:14.607652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83133f-2214-4c29-92b7-07750e4fe6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:14.648915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1f83133f-2214-4c29-92b7-07750e4fe6da None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:14.650183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1f83133f-2214-4c29-92b7-07750e4fe6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:14.817733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 886/1746] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:14.832229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:14.833677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:14.991710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f98e4-78fb-4070-88a4-37fe981b7477 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:15.003357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:15.004046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:15.005022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:15.005022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:15.016827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:15.019338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e161715-a5c1-40ea-a77c-2fc63e006b0a service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:15.043350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 861/1747] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:15.270635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:15.270945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:15.272234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:15.278377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 887/1748] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:37:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:37:15.296355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811354-e69a-4dd4-aad3-7b61cb3574cc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:15.296648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811354-e69a-4dd4-aad3-7b61cb3574cc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:15.296974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19811354-e69a-4dd4-aad3-7b61cb3574cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:15.326136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-19811354-e69a-4dd4-aad3-7b61cb3574cc None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:15.330201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-19811354-e69a-4dd4-aad3-7b61cb3574cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:15.496014 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 862/1749] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:15.534636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:15.537961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:15.564749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555e2c-5b55-425a-a69a-760d0c96a086 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:15.571129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:15.580069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:15.580364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:15.581311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:15.592631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:15.594557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:15.615507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 888/1750] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:15.934688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:15.935592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:15.935881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:15.954371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] MFA Rules not processed for user `765e2a7f731c4facbb94fe8117e0053c`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:15.956826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:16.008835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 863/1751] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:16.111282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:16.113019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:16.151344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0c23f-3c72-4431-818b-a9ba2b0817b3 service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:16.162330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:16.163429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:16.163785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:16.164064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] PATH_INFO: `/v3/projects/505cdf9a7c1a4e2881bce6dc4a591ae3` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:16.167161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=505cdf9a7c1a4e2881bce6dc4a591ae3)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:16.173050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:16.451951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505cdf9a7c1a4e2881bce6dc4a591ae3', 'request_id': 'req-c9053383-ae15-4105-aac4-c0cb1cdf2830'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:16.469424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505cdf9a7c1a4e2881bce6dc4a591ae3', 'request_id': 'req-c9053383-ae15-4105-aac4-c0cb1cdf2830'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:16.507335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505cdf9a7c1a4e2881bce6dc4a591ae3', 'request_id': 'req-c9053383-ae15-4105-aac4-c0cb1cdf2830'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:16.640515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] The token cache is being invalidate because project 505cdf9a7c1a4e2881bce6dc4a591ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:16.641117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:16.645411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9053383-ae15-4105-aac4-c0cb1cdf2830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:16.655210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 889/1752] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:16 2022] DELETE /identity/v3/projects/505cdf9a7c1a4e2881bce6dc4a591ae3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:16.660226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:16.675277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b593c66-a95e-4a97-b2e1-312d93ada28d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:16.805242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:16.805944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:16.806234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:16.806915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] PATH_INFO: `/v3/users/ae032f74272f4756a59cab1611d30d85` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:16.809106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae032f74272f4756a59cab1611d30d85)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:16.816632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:17.180814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae032f74272f4756a59cab1611d30d85'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:17.187535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae032f74272f4756a59cab1611d30d85'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:17.294010 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae032f74272f4756a59cab1611d30d85'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:17.294665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae032f74272f4756a59cab1611d30d85'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:17.295321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae032f74272f4756a59cab1611d30d85'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:17.335183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 864/1753] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:16 2022] DELETE /identity/v3/users/ae032f74272f4756a59cab1611d30d85 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:17.353370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9bfd-7f27-40ea-8598-aaa8c7981f88 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:17.353861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9bfd-7f27-40ea-8598-aaa8c7981f88 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:17.354328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e9bfd-7f27-40ea-8598-aaa8c7981f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:17.386217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a94e9bfd-7f27-40ea-8598-aaa8c7981f88 None None] MFA Rules not processed for user `d4d9ee91364a45d8b423814654f2acc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:17.387429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a94e9bfd-7f27-40ea-8598-aaa8c7981f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:17.491696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 890/1754] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:18.432215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:18.436499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:18.570377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef92759-7f8a-4436-8c0f-8f03a67a6e36 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:18.578024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:18.584494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:18.584494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:18.584494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] PATH_INFO: `/v3/projects/27d3185561cc4f109b017a9e0f2d4427` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:18.584494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3185561cc4f109b017a9e0f2d4427)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:18.584494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:18.711045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3185561cc4f109b017a9e0f2d4427', 'request_id': 'req-25755f5b-ff8c-4576-93e8-ce11db7127d7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:18.717064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3185561cc4f109b017a9e0f2d4427', 'request_id': 'req-25755f5b-ff8c-4576-93e8-ce11db7127d7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:18.722290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3185561cc4f109b017a9e0f2d4427', 'request_id': 'req-25755f5b-ff8c-4576-93e8-ce11db7127d7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:18.828353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] The token cache is being invalidate because project 27d3185561cc4f109b017a9e0f2d4427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:18.831276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:18.831276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25755f5b-ff8c-4576-93e8-ce11db7127d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:18.831959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 865/1755] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:18 2022] DELETE /identity/v3/projects/27d3185561cc4f109b017a9e0f2d4427 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:18.836865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:18.837410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:18.837410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:18.863601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:18.865008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:18.924968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 891/1756] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:18.940151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:18.940459 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:18.940726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:18.958447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:18.959662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:18.967717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 866/1757] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:18.972181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:18.981971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1a44-2195-4914-aebc-ee2bffa4d1a7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:18.986983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:18.987678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:18.987959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:18.988234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:18.988947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:18.989249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:18.990996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.003170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 892/1758] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:19.007835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.017327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf613ba3-b178-4b88-89d5-31405afd01f0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.023268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.025101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.025101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.025101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.025445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.027376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.114111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 867/1759] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:19 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:19.118475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.131044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5254-6b51-43d4-84a6-47797d639433 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.189418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.190688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.194538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.194538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.194538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.194538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.311828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 893/1760] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:19 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:19.316637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.327545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44a542-fa48-4eb8-a205-8ead5246068c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.333296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.334209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.334605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.334949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.338842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.338842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.348503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 868/1761] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:19.352971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.366297 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106fdce-b17c-476c-84de-acb7e398addc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.371084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.371811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.372100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.372411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.373143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.374748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0f493-90d0-4fd5-afe3-d9ed635a733b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.386920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 894/1762] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:19.391744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.409770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09e9a1-ea7e-436c-87fc-290004874c46 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.414562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.415622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.416002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.416375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] PATH_INFO: `/v3/projects/a8647f245dfc405dab3558ed5a157c8e/users/2329879d666943349f6beb8974890907/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.436436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8647f245dfc405dab3558ed5a157c8e, user_id=2329879d666943349f6beb8974890907, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.441964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.534599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 869/1763] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:19 2022] PUT /identity/v3/projects/a8647f245dfc405dab3558ed5a157c8e/users/2329879d666943349f6beb8974890907/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:19.545237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.545539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.548465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.602053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] MFA Rules not processed for user `2329879d666943349f6beb8974890907`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:19.609648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:19.755394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 895/1764] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:19.760107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:19.852063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8462e71-2089-4de1-a8d9-c972b5dd9c89 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:19.857077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:19.857949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:19.858541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:19.864987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:19.866018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:19.868222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:19.991562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 870/1765] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:19 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:19.995738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.011649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a1dc-cdb2-4bc3-b46f-cb887d964b95 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.085819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.086510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.086974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.087271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.088011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.089936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.232050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 896/1766] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:19 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:20.235985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.247605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c0066-76fd-4bd5-92ae-ea7a246eab47 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.252653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.253326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.253610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.253887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.254617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.256285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.271165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 871/1767] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:20.272447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.283173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0f508-537e-47eb-b6e8-ce2b48d886ea admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.288560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.289476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.289757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.290033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] PATH_INFO: `/v3/projects/f2d4061e2f7a4562a39f68ad8057b160/users/287786627b934fc6acfb0a03facdf78a/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.306379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4061e2f7a4562a39f68ad8057b160, user_id=287786627b934fc6acfb0a03facdf78a, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.309165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.422388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 897/1768] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:20 2022] PUT /identity/v3/projects/f2d4061e2f7a4562a39f68ad8057b160/users/287786627b934fc6acfb0a03facdf78a/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:20.433485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.447412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbe7e-743c-43b7-bda3-ae3c779c2d8d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.519736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.520666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.521117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.521579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.522447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.524112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d78d8-9251-4c72-8c91-ddf5e2a43712 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.534514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 872/1769] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:20.539364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.550285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563687d4-0a09-47b1-816d-705785fbd187 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.555023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.556029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.556300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.561260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] PATH_INFO: `/v3/projects/f2d4061e2f7a4562a39f68ad8057b160/users/287786627b934fc6acfb0a03facdf78a/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.561260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d4061e2f7a4562a39f68ad8057b160, user_id=287786627b934fc6acfb0a03facdf78a, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.561260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.582300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 898/1770] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:20 2022] PUT /identity/v3/projects/f2d4061e2f7a4562a39f68ad8057b160/users/287786627b934fc6acfb0a03facdf78a/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:20.592706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.592706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.592706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.622445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] MFA Rules not processed for user `287786627b934fc6acfb0a03facdf78a`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:20.623693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:20.701518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 873/1771] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:20.783043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:20.787959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:20.883286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22068f4e-c791-4934-ad24-f92e92b57bce admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:20.889683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:20.889683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:20.889683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:20.889683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:20.915266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:20.916766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:20.939528 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 899/1772] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:22.448168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:22.461359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ab3fa-7ec7-4656-947b-6e0cb3742b48 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:22.479471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287786627b934fc6acfb0a03facdf78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d4061e2f7a4562a39f68ad8057b160', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:22.480920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:22.481235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:22.485170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:22.486224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:22.488274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:22.490076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:22.510314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 874/1773] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:22.514395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:22.526139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a39f8b-b806-467e-9a6b-9e721903db62 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:22.542818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287786627b934fc6acfb0a03facdf78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d4061e2f7a4562a39f68ad8057b160', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:22.545000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:22.545486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:22.546025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:22.546904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:22.550211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:22.709984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 900/1774] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:22 2022] POST /identity/v3/projects => generated 355 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:22.714393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:22.725833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49fdf-fe94-48c0-ae3e-227a96776e7c tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:22.814758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287786627b934fc6acfb0a03facdf78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d4061e2f7a4562a39f68ad8057b160', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:22.815811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:22.816583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:22.818272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:22.819138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:22.819507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:22.823087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:22.837371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 875/1775] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:22.908606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:22.921606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f63a-3a3d-47cd-8eb9-e3333c2628f5 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:22.927993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '287786627b934fc6acfb0a03facdf78a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2d4061e2f7a4562a39f68ad8057b160', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:22.929160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:22.929526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:22.930388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] PATH_INFO: `/v3/projects/2ce91b4ec02b4f83ad9a3500db784bbb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:22.931875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2ce91b4ec02b4f83ad9a3500db784bbb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:22.933893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:23.140555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce91b4ec02b4f83ad9a3500db784bbb', 'request_id': 'req-45593858-8d1a-4116-8cc4-bbda034eee03'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:23.175214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce91b4ec02b4f83ad9a3500db784bbb', 'request_id': 'req-45593858-8d1a-4116-8cc4-bbda034eee03'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:23.183233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce91b4ec02b4f83ad9a3500db784bbb', 'request_id': 'req-45593858-8d1a-4116-8cc4-bbda034eee03'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:23.493532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] The token cache is being invalidate because project 2ce91b4ec02b4f83ad9a3500db784bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:23.495879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:23.495879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-45593858-8d1a-4116-8cc4-bbda034eee03 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:23.497153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 901/1776] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:22 2022] DELETE /identity/v3/projects/2ce91b4ec02b4f83ad9a3500db784bbb => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:25.004207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:25.006070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:25.070557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60276d01-c08c-4904-9479-960ae941a673 tempest-VolumeQuotaClassesTest-1871581483 tempest-VolumeQuotaClassesTest-1871581483-project-admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:25.124136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:25.125017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:25.125305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:25.125582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] PATH_INFO: `/v3/users/2329879d666943349f6beb8974890907` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:25.126775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2329879d666943349f6beb8974890907)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:25.129352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:25.359043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2329879d666943349f6beb8974890907'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:25.366656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2329879d666943349f6beb8974890907'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:25.434570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2329879d666943349f6beb8974890907'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:25.435202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2329879d666943349f6beb8974890907'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:25.435848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2329879d666943349f6beb8974890907'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:25.453673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 876/1777] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:25 2022] DELETE /identity/v3/users/2329879d666943349f6beb8974890907 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:25.458278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:25.458763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:25.458856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:25.476142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:25.477374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:25.546550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 902/1778] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:25.600114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:25.601998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:25.687920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11af2-961c-4a4f-a01d-f9420d68cc4f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:25.693072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:25.693881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:25.694274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:25.694656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:25.727133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:25.729617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8ebb1-c6b7-4736-983e-d3fda7dd24d7 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:25.755752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 877/1779] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:26.792618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:26.794183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:26.805447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f19e4-2b2a-48c7-a732-55c8c27613a6 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:26.805909 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f19e4-2b2a-48c7-a732-55c8c27613a6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:26.805998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f19e4-2b2a-48c7-a732-55c8c27613a6 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:26.809430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 878/1780] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:37:26.821582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:26.821866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:26.822197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:26.834361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1426966-b116-4d22-8260-79a0ed006279 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:26.850453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:26.854111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:26.856719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:26.857044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:26.857200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] PATH_INFO: `/v3/projects/a8647f245dfc405dab3558ed5a157c8e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:26.857276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:26.861259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8647f245dfc405dab3558ed5a157c8e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:26.883799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:26.987719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 879/1781] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:37:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:27.018343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:27.024084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:27.038314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c2439-4ce3-49c6-898f-3b01cf0f1ead None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:27.045134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:27.046313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:27.046807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:27.047267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:27.061862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:27.065473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:27.081066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 880/1782] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:27.144682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8647f245dfc405dab3558ed5a157c8e', 'request_id': 'req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.156307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8647f245dfc405dab3558ed5a157c8e', 'request_id': 'req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.191487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8647f245dfc405dab3558ed5a157c8e', 'request_id': 'req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.278389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] The token cache is being invalidate because project a8647f245dfc405dab3558ed5a157c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:27.278389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.278389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.294043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 903/1783] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:26 2022] DELETE /identity/v3/projects/a8647f245dfc405dab3558ed5a157c8e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:27.307555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:27.337993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a2717-08ee-43cf-af5e-5ff539a11816 service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:27.490611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:27.491788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:27.492198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:27.492759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] PATH_INFO: `/v3/users/287786627b934fc6acfb0a03facdf78a` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:27.494176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] RBAC: Authorizing `identity:delete_user(user_id=287786627b934fc6acfb0a03facdf78a)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:27.496596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:27.762522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287786627b934fc6acfb0a03facdf78a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.776181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287786627b934fc6acfb0a03facdf78a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.888505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287786627b934fc6acfb0a03facdf78a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.889533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287786627b934fc6acfb0a03facdf78a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.890226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5e8af1b0-31e1-4e82-9880-3ba307e8deea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287786627b934fc6acfb0a03facdf78a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:27.910983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 881/1784] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:27 2022] DELETE /identity/v3/users/287786627b934fc6acfb0a03facdf78a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:29.299336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:29.301492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:29.345201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9fd3-656e-40a4-b6fc-deba25b34e9f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:29.514085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:29.515224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:29.515561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:29.515851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] PATH_INFO: `/v3/projects/f2d4061e2f7a4562a39f68ad8057b160` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:29.518162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d4061e2f7a4562a39f68ad8057b160)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:29.520579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:29.650402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d4061e2f7a4562a39f68ad8057b160', 'request_id': 'req-a354cfff-f19a-4877-881f-9bc8bd4f3888'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:29.658373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d4061e2f7a4562a39f68ad8057b160', 'request_id': 'req-a354cfff-f19a-4877-881f-9bc8bd4f3888'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:29.665742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d4061e2f7a4562a39f68ad8057b160', 'request_id': 'req-a354cfff-f19a-4877-881f-9bc8bd4f3888'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:29.771790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] The token cache is being invalidate because project f2d4061e2f7a4562a39f68ad8057b160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:29.773655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:29.773655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a354cfff-f19a-4877-881f-9bc8bd4f3888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:29.776722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 904/1785] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:29 2022] DELETE /identity/v3/projects/f2d4061e2f7a4562a39f68ad8057b160 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:29.781901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:29.782384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:29.782481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:29.811034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:29.813937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:29.897313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 882/1786] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:29.906765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:29.907184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:29.907626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:29.927970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:29.929247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:29.937846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 905/1787] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:29.942740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:29.952664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f0f5-31bc-48f8-b478-58cc73c013d8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:29.957823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:29.958478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:29.958848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:29.959130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:29.959939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:29.960204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:29.961801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:29.975603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 883/1788] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:29.989058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.003092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42760f6e-7243-4074-bfa5-c72fa41794e2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.013305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.014632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.015410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.015556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.016507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.018524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.144907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 906/1789] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:29 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:30.153613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.164847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769ee07-6506-4af9-b48f-4cfe33921a91 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.219908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.220581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.221401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.221681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.222758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.224707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.334670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 884/1790] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:30 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:30.338653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.349202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef7c49-8c57-4d78-82b2-ba4c37ad0b42 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.353726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.354375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.354655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.354928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.355683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.357263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.367532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 907/1791] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:30.371481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.381261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc72b0-041e-47f2-a958-40f620e9eb28 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.385904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.386556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.386844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.387125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.387891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.389510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25513364-ed14-4fab-a10d-f89e30f3567e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.399630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 885/1792] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:30.403475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.413788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1493e6-02c7-446b-b890-08c347adc271 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.418241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.419092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.419480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.419759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] PATH_INFO: `/v3/projects/c4d46bf45ad14a509d1d8905fa213ca1/users/d02a21be12cc4580bef7a2d60e68b235/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.433945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d46bf45ad14a509d1d8905fa213ca1, user_id=d02a21be12cc4580bef7a2d60e68b235, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.436573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.548887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 908/1793] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:30 2022] PUT /identity/v3/projects/c4d46bf45ad14a509d1d8905fa213ca1/users/d02a21be12cc4580bef7a2d60e68b235/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:30.559905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.560203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.560486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.587537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] MFA Rules not processed for user `d02a21be12cc4580bef7a2d60e68b235`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:30.588734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:30.653428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 886/1794] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:30.658281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.718789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d263211-ebac-47db-a528-8800cce52711 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.724054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.724712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.724995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.725269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.725969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.727896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:30.865570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 909/1795] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:30.870902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:30.883224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b04ed-4d56-44c7-b873-ea1664de6181 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:30.946778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:30.947691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:30.956229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:30.956229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:30.956229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:30.956229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.125870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 887/1796] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:30 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:31.128331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:31.139237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb7be-92f0-41f8-9572-9c7ebc47a134 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:31.144653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:31.145397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.145997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.146284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.147018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:31.148680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.167354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 910/1797] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:31.169544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:31.185419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab53ef9-dce0-40f3-90e1-f57dab2f5c35 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:31.187671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:31.188556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.189113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.189391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] PATH_INFO: `/v3/projects/a05e88fcdd1e49e9afef64d921a72c95/users/9bc64e48cd5f48069aaf8f3aa7d823e2/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.204469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05e88fcdd1e49e9afef64d921a72c95, user_id=9bc64e48cd5f48069aaf8f3aa7d823e2, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:31.209071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.305717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 888/1798] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:31 2022] PUT /identity/v3/projects/a05e88fcdd1e49e9afef64d921a72c95/users/9bc64e48cd5f48069aaf8f3aa7d823e2/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:31.310087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:31.320428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1851b9-9b32-43d1-926b-7c7f37d8090d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:31.384851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:31.385531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.385807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.386088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.386819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:31.388466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425a083-9e1b-415a-83c7-d5de6690a3c7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.399062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 911/1799] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:31.403404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:31.416221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b714-0732-475c-8a54-b74c931674da admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:31.420819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:31.421740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.422022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.422294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] PATH_INFO: `/v3/projects/a05e88fcdd1e49e9afef64d921a72c95/users/9bc64e48cd5f48069aaf8f3aa7d823e2/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.424342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05e88fcdd1e49e9afef64d921a72c95, user_id=9bc64e48cd5f48069aaf8f3aa7d823e2, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:31.427189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.437693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 889/1800] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:31 2022] PUT /identity/v3/projects/a05e88fcdd1e49e9afef64d921a72c95/users/9bc64e48cd5f48069aaf8f3aa7d823e2/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:31.449869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.450159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.450438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.477438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] MFA Rules not processed for user `9bc64e48cd5f48069aaf8f3aa7d823e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:31.478775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:31.549855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 912/1801] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:31.559496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:31.561782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:31.623542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496cb2f-02ef-40fc-a86d-74ef20ebc7cc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:31.627676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:31.628324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:31.628612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:31.628893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:31.642628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:31.644652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac21f-c65b-46b9-856e-5c9c773f3d2f service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:31.654873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 890/1802] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:33.087745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:33.155750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a77f0-8779-4017-b6fd-7ff1fbe5b610 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:33.160600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:33.161493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:33.161783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:33.162066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] PATH_INFO: `/v3/users/d02a21be12cc4580bef7a2d60e68b235` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:33.163326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02a21be12cc4580bef7a2d60e68b235)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:33.165458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:33.332587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02a21be12cc4580bef7a2d60e68b235'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:33.345700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02a21be12cc4580bef7a2d60e68b235'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:33.402736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02a21be12cc4580bef7a2d60e68b235'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:33.404604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02a21be12cc4580bef7a2d60e68b235'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:33.408171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02a21be12cc4580bef7a2d60e68b235'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:33.433529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 913/1803] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:33 2022] DELETE /identity/v3/users/d02a21be12cc4580bef7a2d60e68b235 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:33.437756 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:33.438287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:33.438366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:33.461610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:33.463002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:33.563154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 891/1804] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:33.574200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:33.576021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:33.641156 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38354b65-528a-4ce2-be00-210f2a7954ad admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:33.645116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:33.645776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:33.646073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:33.646340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:33.656934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:33.659130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:33.670506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 914/1805] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:34.211846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:34.213759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:34.245318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9c65-c15f-441b-8a3d-d077c6f50a9a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:34.263384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:34.263384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:34.263384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:34.263384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] PATH_INFO: `/v3/projects/c4d46bf45ad14a509d1d8905fa213ca1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:34.265137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d46bf45ad14a509d1d8905fa213ca1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:34.269643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:34.462231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d46bf45ad14a509d1d8905fa213ca1', 'request_id': 'req-203284aa-47d6-4d62-86f2-95aedd784ee7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:34.492196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d46bf45ad14a509d1d8905fa213ca1', 'request_id': 'req-203284aa-47d6-4d62-86f2-95aedd784ee7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:34.522870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d46bf45ad14a509d1d8905fa213ca1', 'request_id': 'req-203284aa-47d6-4d62-86f2-95aedd784ee7'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:34.608035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] The token cache is being invalidate because project c4d46bf45ad14a509d1d8905fa213ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:34.608329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:34.609185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:34.610917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 892/1806] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:34 2022] DELETE /identity/v3/projects/c4d46bf45ad14a509d1d8905fa213ca1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:34.615456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:34.626354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea39fe6-153c-4128-9493-b7123381b644 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:34.715279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:34.716231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:34.716686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:34.717108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] PATH_INFO: `/v3/users/9bc64e48cd5f48069aaf8f3aa7d823e2` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:34.718708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc64e48cd5f48069aaf8f3aa7d823e2)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:34.720676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:34.997402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc64e48cd5f48069aaf8f3aa7d823e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.011351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc64e48cd5f48069aaf8f3aa7d823e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.144272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc64e48cd5f48069aaf8f3aa7d823e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.146598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc64e48cd5f48069aaf8f3aa7d823e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.166642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0af8858-c3cc-4361-b281-bf94be42df82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc64e48cd5f48069aaf8f3aa7d823e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.189263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 915/1807] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:34 2022] DELETE /identity/v3/users/9bc64e48cd5f48069aaf8f3aa7d823e2 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:35.704553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:35.704553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:35.733474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203284aa-47d6-4d62-86f2-95aedd784ee7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:35.819580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:35.820458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:35.820757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:35.821283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] PATH_INFO: `/v3/projects/a05e88fcdd1e49e9afef64d921a72c95` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:35.823065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05e88fcdd1e49e9afef64d921a72c95)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:35.825620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:35.984035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05e88fcdd1e49e9afef64d921a72c95', 'request_id': 'req-961439bb-a2d5-45c4-a4be-9ec134bb540d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:35.993427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05e88fcdd1e49e9afef64d921a72c95', 'request_id': 'req-961439bb-a2d5-45c4-a4be-9ec134bb540d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:36.005472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05e88fcdd1e49e9afef64d921a72c95', 'request_id': 'req-961439bb-a2d5-45c4-a4be-9ec134bb540d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:36.088481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] The token cache is being invalidate because project a05e88fcdd1e49e9afef64d921a72c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:36.088984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:36.090393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-961439bb-a2d5-45c4-a4be-9ec134bb540d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:36.093324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 893/1808] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:35 2022] DELETE /identity/v3/projects/a05e88fcdd1e49e9afef64d921a72c95 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:36.098801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.099240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.099416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.121847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:36.123481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:36.200774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 916/1809] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:36.208697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.208997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.209301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.227833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:36.229034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:36.237508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 894/1810] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:36.241675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.251498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf495-9c9d-4160-944b-c69b37227545 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.256560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.257222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.257504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.257780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.258507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:36.258811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.260440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.272510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 917/1811] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:36.277605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.288441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9992dff-808b-43e2-9d8a-f30e11322c69 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.293443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.294210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.295437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.295437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.296062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.298037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.376802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 895/1812] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:36 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:36.378452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.389481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c034e0-cd2c-44c0-ae74-b566efbd6e2d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.481248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.481931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.482220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.482500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.483204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.485300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.648721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 918/1813] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:36 2022] POST /identity/v3/users => generated 286 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:36.652550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.663787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a84-4d41-48d4-9823-0bbd60d89995 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.668453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.669267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.669544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.669827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.670552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.672204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.683172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 896/1814] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:36.687323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.697178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529c93-ba62-4031-b6d8-99fc6531184a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.701853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.702538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.702909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.703185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.703948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.705772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b8227-4852-4d49-974e-72ba9110f273 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.725479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 919/1815] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:36.728699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:36.741648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef8d0-7998-4e80-92a2-8c90dfc05c47 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:36.754252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:36.756023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.756523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.756999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] PATH_INFO: `/v3/projects/a42797fd39f04069893c3d64f19d2f7c/users/d0550489a75240668137d248fd3714ff/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.802858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42797fd39f04069893c3d64f19d2f7c, user_id=d0550489a75240668137d248fd3714ff, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:36.805553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:36.929211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 897/1816] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:36 2022] PUT /identity/v3/projects/a42797fd39f04069893c3d64f19d2f7c/users/d0550489a75240668137d248fd3714ff/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:36.934338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:36.934636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:36.934953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:36.954754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:36.956601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:37.023686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 920/1817] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:37.035853 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:37.037727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:37.097676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5721c6-5b4c-411f-a7d3-cd054f564e12 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:37.101522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:37.102168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:37.102624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:37.102904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:37.114262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:37.115974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc625ac-3612-424a-9013-4116c5489377 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:37.125806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 898/1818] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:37.901700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:37.903122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:37.916220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955f629-7449-4e24-8294-3f50d59173d0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:37.920838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:37.921709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:37.921999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:37.922283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] PATH_INFO: `/v3/users/c4a13bde51b04333aab56a463c91c378` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:37.923522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a13bde51b04333aab56a463c91c378)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:37.925547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:38.204215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a13bde51b04333aab56a463c91c378'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:38.214767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a13bde51b04333aab56a463c91c378'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:38.274926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a13bde51b04333aab56a463c91c378'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:38.275767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a13bde51b04333aab56a463c91c378'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:38.276429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3333dfad-77ff-4fa3-8f84-e43c75d75f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a13bde51b04333aab56a463c91c378'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:38.300664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 921/1819] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:37 2022] DELETE /identity/v3/users/c4a13bde51b04333aab56a463c91c378 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:38.304933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.305782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.306202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.332046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:38.332046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:38.498113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 899/1820] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:38.513178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.513607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.513982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.516241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:38.519166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:38.556634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] MFA Rules not processed for user `d0550489a75240668137d248fd3714ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:38.558188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:38.644865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53ae9d-8c31-4341-a4f7-f6f2557445d8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:38.653234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:38.653915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.654469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.654746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.670507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:38.672152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d37981-3513-41fd-b38a-0cf6bfa6d3f2 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:38.686006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 922/1821] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:38.686597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 900/1822] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:38.690133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:38.696171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:38.725220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf782f-2a82-4d58-b4f0-3cf8bcdec8a0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:38.731393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:38.732434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.734216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.739639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.739639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:38.739639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:38.779618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201025a-f948-41ca-82d4-853db42ee4f5 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.779910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201025a-f948-41ca-82d4-853db42ee4f5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.780281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201025a-f948-41ca-82d4-853db42ee4f5 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.782077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 901/1823] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:37:38.805594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:38.805960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:38.806308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:38.827616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:38.829032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:38.849851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 923/1824] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:38 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:38.850857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:38.942281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 902/1825] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:37:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:38.997358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b12642-80fd-49ac-8251-fcab071a31e7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.016952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.017721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.018521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.019377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.020231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.022290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.027599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.028919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:39.048992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfbc0-2f46-423a-90b3-4d75d06c6318 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.138857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 924/1826] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:38 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:39.142788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.146411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.147141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.147939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.148235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.162911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.164847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.192598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 903/1827] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:39.199004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2777b-0f10-471c-86dc-6a4f286269a7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.216554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.216554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.216554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.216554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.216995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.216995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.224366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 925/1828] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:39.225809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.252933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4bed8-4edb-4004-9883-9e49d487dedd service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.266394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.270816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.271623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.271623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] PATH_INFO: `/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b/users/86a4689d42f34e1c9237cd38e6c63479/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.308653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bf91f1a5c34a35ba5f4081b07f476b, user_id=86a4689d42f34e1c9237cd38e6c63479, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.312602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.386407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.388602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:39.401739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 904/1829] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:39 2022] PUT /identity/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b/users/86a4689d42f34e1c9237cd38e6c63479/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:39.405686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.411166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecdd01-2f93-4063-bfd3-04580be6efa9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.496599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1031c1-179f-40fe-aeb0-34df3418ac2d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.501605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.509504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.510687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.510985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.511548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.511886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.512262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.512548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] PATH_INFO: `/v3/projects/dc236ca35ec94a59b09b9073843559ae` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.513390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.513999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc236ca35ec94a59b09b9073843559ae)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.516202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.523341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.545544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 905/1830] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:39.549776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.559631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31b54-694a-4475-bdc6-8ef0eb36f8fe admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:39.564492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:39.565381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:39.565722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:39.566007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] PATH_INFO: `/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b/users/86a4689d42f34e1c9237cd38e6c63479/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:39.568032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bf91f1a5c34a35ba5f4081b07f476b, user_id=86a4689d42f34e1c9237cd38e6c63479, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:39.570751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:39.588560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 906/1831] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:39 2022] PUT /identity/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b/users/86a4689d42f34e1c9237cd38e6c63479/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:39.716739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc236ca35ec94a59b09b9073843559ae', 'request_id': 'req-d265645c-cbdd-4253-8509-2d76148fd62a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:39.724979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc236ca35ec94a59b09b9073843559ae', 'request_id': 'req-d265645c-cbdd-4253-8509-2d76148fd62a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:39.741748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc236ca35ec94a59b09b9073843559ae', 'request_id': 'req-d265645c-cbdd-4253-8509-2d76148fd62a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:39.848934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] The token cache is being invalidate because project dc236ca35ec94a59b09b9073843559ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:39.848934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:39.849925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:39.854868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 926/1832] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:39 2022] DELETE /identity/v3/projects/dc236ca35ec94a59b09b9073843559ae => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:39.856021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:39.858296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:39.931060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31885874-6d9d-421c-821f-3bb580454543 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:40.002979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:40.004163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:40.004533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:40.004920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] PATH_INFO: `/v3/users/e735bb8e363844c7be1a2a2a41ea9c66` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:40.006158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e735bb8e363844c7be1a2a2a41ea9c66)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:40.008446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:40.265292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e735bb8e363844c7be1a2a2a41ea9c66'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:40.272084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e735bb8e363844c7be1a2a2a41ea9c66'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:40.337015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e735bb8e363844c7be1a2a2a41ea9c66'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:40.337640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e735bb8e363844c7be1a2a2a41ea9c66'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:40.338294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-afa3371d-83ba-48e8-9a89-5ae54695487a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e735bb8e363844c7be1a2a2a41ea9c66'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:40.356139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 907/1833] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:39 2022] DELETE /identity/v3/users/e735bb8e363844c7be1a2a2a41ea9c66 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:41.257122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:41.271979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265645c-cbdd-4253-8509-2d76148fd62a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:41.344015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:41.344923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.345152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.345433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] PATH_INFO: `/v3/projects/2c682363997e485bbaed5d0fbb2af4f6` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.347180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c682363997e485bbaed5d0fbb2af4f6)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:41.349100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:41.484448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c682363997e485bbaed5d0fbb2af4f6', 'request_id': 'req-d5be859f-57f0-4645-a66f-4c3d3879de17'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:41.495856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c682363997e485bbaed5d0fbb2af4f6', 'request_id': 'req-d5be859f-57f0-4645-a66f-4c3d3879de17'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:41.506029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c682363997e485bbaed5d0fbb2af4f6', 'request_id': 'req-d5be859f-57f0-4645-a66f-4c3d3879de17'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:41.536235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.536700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.536842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.571823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] MFA Rules not processed for user `86a4689d42f34e1c9237cd38e6c63479`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:41.573365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:41.631091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] The token cache is being invalidate because project 2c682363997e485bbaed5d0fbb2af4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:41.631423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:41.632080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d5be859f-57f0-4645-a66f-4c3d3879de17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:41.637640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 927/1834] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:41 2022] DELETE /identity/v3/projects/2c682363997e485bbaed5d0fbb2af4f6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:41.639227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66130bd-0b18-4aec-bd12-2582434a6009 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.639558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66130bd-0b18-4aec-bd12-2582434a6009 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.639846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66130bd-0b18-4aec-bd12-2582434a6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.661529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e66130bd-0b18-4aec-bd12-2582434a6009 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:41.662640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e66130bd-0b18-4aec-bd12-2582434a6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:41.664027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 908/1835] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:41.701613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:41.703505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:41.728784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 928/1836] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:41.737697 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.737991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.738327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.757424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:41.758678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:41.766887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 929/1837] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:41.771593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:41.777905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73795ed-6549-4263-9083-e82fdc901905 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:41.781321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0f35f-3d0d-4ba3-b297-3237b44088d2 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:41.782341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:41.783717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.784150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.784587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.786486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:41.787032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:41.787815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.788094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.788381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.789141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:41.789452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:41.791049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:41.807087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 930/1838] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:37:41.808033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:41.818729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480469-413a-45b4-988b-9e4efc547b87 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:41.824426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:41.825008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:41.825305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:41.825588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:41.826283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:41.828277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:41.857290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:41.858762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:41.869939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 909/1839] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:41.951471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 931/1840] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:41 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:41.955831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:41.988516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183772-576e-4490-87ff-e339ddcb48ab service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.080712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.081825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.082553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.083047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.084622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.087576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.093870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.096612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:42.117086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b64a06-37b4-4c71-aa4e-1063d89c3a4a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.122136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.123326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.124559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.124559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] PATH_INFO: `/v3/users/cf24f8f3e06c43608bbf1774e8f26b35` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.125445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf24f8f3e06c43608bbf1774e8f26b35)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.127914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.273202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 910/1841] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:41 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:42.277194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.289778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037392-606a-4ac9-bad1-0a8e302d547c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.296379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.300730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.300730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.300730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.300730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.300730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.314473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 911/1842] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:42.318520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.328406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7907ac-32d1-421c-8661-081eefd64abc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.334937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.335915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.336509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.336864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.337684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.339544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.354472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 912/1843] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:42.356354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.370740 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ec2ff-6961-4b3a-9e49-4bb3cc99d9cd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.376575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.377531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.378015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.378411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] PATH_INFO: `/v3/projects/b88bb067945043ec89a1661d0992207d/users/8865c79381c6474db8a12181aa85d500/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.379565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf24f8f3e06c43608bbf1774e8f26b35'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:42.387070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf24f8f3e06c43608bbf1774e8f26b35'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:42.395285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88bb067945043ec89a1661d0992207d, user_id=8865c79381c6474db8a12181aa85d500, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.397969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0fce6-1703-47f2-8664-676f470f0f3c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.483817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf24f8f3e06c43608bbf1774e8f26b35'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:42.484383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf24f8f3e06c43608bbf1774e8f26b35'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:42.485247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-26705eea-0385-47da-8065-f980b05ce64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf24f8f3e06c43608bbf1774e8f26b35'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:42.490265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 913/1844] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:42 2022] PUT /identity/v3/projects/b88bb067945043ec89a1661d0992207d/users/8865c79381c6474db8a12181aa85d500/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:42.500269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.500700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.500990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.509172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 932/1845] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:42 2022] DELETE /identity/v3/users/cf24f8f3e06c43608bbf1774e8f26b35 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:42.514339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.514339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.514559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.533493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:42.535176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] MFA Rules not processed for user `8865c79381c6474db8a12181aa85d500`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:42.535414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:42.536421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:42.620703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 933/1846] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:42.624462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 914/1847] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:42.628605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.630147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:42.630542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.632079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:42.647556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45daea9-98c7-4c97-9fb3-03958794daf6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.654364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.655602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.655602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.655796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.656488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.658966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.708828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b059800-0bf8-4508-a8b9-1be6310122b8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.714523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.715451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.715879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.716341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.737657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.748955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.752888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 934/1848] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:42.771860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 915/1849] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:42 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:42.773923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.784665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4807-1d80-41ab-bdca-0bf6dc50fe52 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.863819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.864503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.864790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.865069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.865820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.867872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:42.977321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 935/1850] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:42 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:42.977511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:42.987377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0345-3aa7-4c4e-a8b1-9dc12a2ace56 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:42.993090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:42.993872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:42.994434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:42.994785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:42.995724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:42.997494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.027347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 916/1851] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:43.030291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.040665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a03abe-6db1-4bbb-bba6-b671dd8f99ff admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.045965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.046792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.047080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.047387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.048141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.050290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c952-f65f-4820-ad74-f2b97c3bfe4e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.064024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 936/1852] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:43.068687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.078941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead730e-66c6-4c3e-8492-afc66fff6984 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.086275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.087951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.088393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.089295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] PATH_INFO: `/v3/projects/6b1cd2c7164c484e96276720aadcaca3/users/c6e849b404b74a1b91ccefba20e45d3d/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.105173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1cd2c7164c484e96276720aadcaca3, user_id=c6e849b404b74a1b91ccefba20e45d3d, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.108491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.180995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 917/1853] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:43 2022] PUT /identity/v3/projects/6b1cd2c7164c484e96276720aadcaca3/users/c6e849b404b74a1b91ccefba20e45d3d/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:43.192084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.192410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.192705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.218050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.219996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:43.256082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] MFA Rules not processed for user `c6e849b404b74a1b91ccefba20e45d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:43.257307 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:43.301038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6545dca-53de-44ed-9e79-42a9c6bd02b1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.306848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.307755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.308037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.308309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] PATH_INFO: `/v3/projects/a36ef3a6427d4cb1ab1d45142eb34588` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.309550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36ef3a6427d4cb1ab1d45142eb34588)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.312197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.342881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 937/1854] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:43.347963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.359430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d10e57-c170-4848-805d-855f171a0cfa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.365361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.366679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.366974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.367257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.368011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.370141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.451370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36ef3a6427d4cb1ab1d45142eb34588', 'request_id': 'req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.462551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36ef3a6427d4cb1ab1d45142eb34588', 'request_id': 'req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.469913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36ef3a6427d4cb1ab1d45142eb34588', 'request_id': 'req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.563141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 938/1855] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:43 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:43.566716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.590411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] The token cache is being invalidate because project a36ef3a6427d4cb1ab1d45142eb34588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:43.591785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.592759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.596489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 918/1856] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:43 2022] DELETE /identity/v3/projects/a36ef3a6427d4cb1ab1d45142eb34588 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:43.600267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.602496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:43.642764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff157d1e-b761-4f6a-8e8c-7b44d9777dde admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.647475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.648140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.648428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.648702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.649385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.651287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.685367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc084e7-f26d-45b4-a1b9-f32f03e7f015 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.690259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.691242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.691591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.691869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] PATH_INFO: `/v3/users/e3d9719326d04ee68e61bca170294f25` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.693166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d9719326d04ee68e61bca170294f25)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.695125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.752414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 939/1857] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:43 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:37:43.756128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.757937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:43.772235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378c1e-0265-4d83-854b-e324e31a2ee2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.779550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.781698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.782197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.782610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.784093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.788609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.801264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 940/1858] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:43.802775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.814448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89736b-c152-414b-83aa-764a593435a9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:43.819367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:43.823190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:43.823190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:43.823190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] PATH_INFO: `/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9/users/a6cd76b8716f470bb1603dac38e7ff13/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:43.838159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f5bafaedfa4a1482b5c560f18b61b9, user_id=a6cd76b8716f470bb1603dac38e7ff13, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:43.841620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:43.956201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 941/1859] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:43 2022] PUT /identity/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9/users/a6cd76b8716f470bb1603dac38e7ff13/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:43.957084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:43.958940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:43.963541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d9719326d04ee68e61bca170294f25'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:43.971784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d9719326d04ee68e61bca170294f25'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.020887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d94bd-e60b-4e86-9f8e-856033e8f174 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.024733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.025383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.025830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.026114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.028605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.048504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d9719326d04ee68e61bca170294f25'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.049179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d9719326d04ee68e61bca170294f25'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.049797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d9719326d04ee68e61bca170294f25'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.069577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 919/1860] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:43 2022] DELETE /identity/v3/users/e3d9719326d04ee68e61bca170294f25 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:44.070653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:44.072066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.103053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.104903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.151615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 942/1861] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:44.202655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62be60e-d829-46d5-9cb8-bbd05dda9478 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.208271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.209025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.209401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.209749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.210583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.212305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc38617-9035-45cf-b454-afc794306ba2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.222477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 920/1862] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:44.226823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:44.288353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68f17f-2e01-4b9b-bdf7-d57d8d254bde service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.293080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.294031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.294265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.294582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] PATH_INFO: `/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9/users/a6cd76b8716f470bb1603dac38e7ff13/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.296610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f5bafaedfa4a1482b5c560f18b61b9, user_id=a6cd76b8716f470bb1603dac38e7ff13, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.299321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.309744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 943/1863] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:44 2022] PUT /identity/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9/users/a6cd76b8716f470bb1603dac38e7ff13/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:44.320437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.320738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.321023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.366735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] MFA Rules not processed for user `a6cd76b8716f470bb1603dac38e7ff13`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:44.367953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.473049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 921/1864] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:44.486805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:44.488691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.552538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdf1eb-ef92-4e15-ae6b-25e9a38b37a2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.557633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.558480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.558769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.559051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.570106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.571595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.578750 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:44.581493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.586073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 944/1865] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:44.660698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499e851-2772-4e7e-a3c1-7c8431d6c638 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.666556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.667462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.667803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.668088 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] PATH_INFO: `/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.669485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad15e20fb6640ddb1f11f4f045cb6b4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.671701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.727130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:44.728804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.745013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e20a7-2e4a-41dd-b293-22f199ec028b service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:44.748868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:44.749587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:44.749942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:44.751366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:44.752818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:44.814954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:44.816526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c4e30-4e8d-4808-933e-f6e435a08b8a service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:44.837181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 945/1866] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:37:44.844005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad15e20fb6640ddb1f11f4f045cb6b4', 'request_id': 'req-46b47d91-3133-499f-b83e-ddc49b8f8703'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.864666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad15e20fb6640ddb1f11f4f045cb6b4', 'request_id': 'req-46b47d91-3133-499f-b83e-ddc49b8f8703'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:44.878141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad15e20fb6640ddb1f11f4f045cb6b4', 'request_id': 'req-46b47d91-3133-499f-b83e-ddc49b8f8703'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:45.003046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] The token cache is being invalidate because project 1ad15e20fb6640ddb1f11f4f045cb6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:45.003384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:45.004040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-46b47d91-3133-499f-b83e-ddc49b8f8703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:45.005668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 922/1867] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:44 2022] DELETE /identity/v3/projects/1ad15e20fb6640ddb1f11f4f045cb6b4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:45.010810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.011220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.011639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.033864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:45.035283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:45.108058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 946/1868] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:45.109702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.110106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.110866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.129722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:45.131131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:45.139930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 923/1869] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:37:45.147496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.157514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b3d8-0009-4df6-901f-b025ab652445 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.162561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.163221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.163545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.163823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.164537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:37:45.164847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.166442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.177730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 947/1870] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:37:45.181997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.191639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719c075-d094-4dc4-8ba2-dee99619d345 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.196318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.196975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.197255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.197534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.198218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.200150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.308470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 924/1871] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:45.311123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.320933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2294f6b-92fd-4b43-aca5-5acaa3dba640 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.387722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.388416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.388706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.388990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.389689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.391701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.488436 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 948/1872] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:45.492502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.504517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b751165-b026-4809-a6e4-5b1e6525444f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.509504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.510187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.510472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.510752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.511555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.513323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.527654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 925/1873] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:45.528942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.539601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d4d4-f82b-4900-bac1-03e413c59f4a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.544759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.545431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.546122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.546122 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.547023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.549275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633195a9-c38c-4ac1-ab3e-fa2f9f7303c6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.562919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 949/1874] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:45.564025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.575111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f9c6f-01ff-4aad-b0f1-75aab14a7842 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.581980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.583056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.583370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.583656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] PATH_INFO: `/v3/projects/66b1d5b2b33e4b588e7eea3920e72afa/users/973e6a7e161540d598503f085521781e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.600642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b1d5b2b33e4b588e7eea3920e72afa, user_id=973e6a7e161540d598503f085521781e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:45.604103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:45.683577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 926/1875] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:45 2022] PUT /identity/v3/projects/66b1d5b2b33e4b588e7eea3920e72afa/users/973e6a7e161540d598503f085521781e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:45.694439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.694934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.695039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.725845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] MFA Rules not processed for user `973e6a7e161540d598503f085521781e`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:45.727067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:45.816541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 950/1876] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:45.821305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:45.979059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822280-f59c-42e7-a64d-81808482cbda admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:45.993789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:45.994582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:45.996751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:45.997232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:45.998046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.005771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.132543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 927/1877] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:37:45 2022] POST /identity/v3/projects => generated 365 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:46.133946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.145719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf133d-a4f8-4857-928e-12fcb27b7580 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.232336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.233367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.233845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.240743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.240743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.240743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.405902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 951/1878] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:37:46 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:37:46.410371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.421076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7fe1f-9104-4790-a2b6-caac4c73a85c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.425761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.426440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.426766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.427828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.427828 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.429440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.443457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 928/1879] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:37:46.444757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.456627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0e66-ee13-4e19-854a-00824e40135f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.467608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.468572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.468867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.470602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] PATH_INFO: `/v3/projects/6104145b072043b1acc1aa5078cfa1e2/users/5e083c841c154c6e9d69a1b35a89c1ed/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.487465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6104145b072043b1acc1aa5078cfa1e2, user_id=5e083c841c154c6e9d69a1b35a89c1ed, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.490168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.604027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 952/1880] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:46 2022] PUT /identity/v3/projects/6104145b072043b1acc1aa5078cfa1e2/users/5e083c841c154c6e9d69a1b35a89c1ed/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:37:46.608331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.623048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98328812-a70e-42d1-90ee-dd1beb1fb6e7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.688751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.690043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.690299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.690573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.691362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.693196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4973-c218-43b1-af64-0a377b7d0210 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.704417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 929/1881] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:37:46.709388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.722305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda49d88-e9dc-4a5a-a9ef-3f59e7329eaf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.727958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.728899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.729182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.729455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] PATH_INFO: `/v3/projects/6104145b072043b1acc1aa5078cfa1e2/users/5e083c841c154c6e9d69a1b35a89c1ed/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.731499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6104145b072043b1acc1aa5078cfa1e2, user_id=5e083c841c154c6e9d69a1b35a89c1ed, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.734142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.745645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 953/1882] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:37:46 2022] PUT /identity/v3/projects/6104145b072043b1acc1aa5078cfa1e2/users/5e083c841c154c6e9d69a1b35a89c1ed/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:46.756431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.756724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.757005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.786084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] MFA Rules not processed for user `5e083c841c154c6e9d69a1b35a89c1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:46.787424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:46.869049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 930/1883] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:46.880252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:46.882369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:46.943663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1cba-ad9b-467c-98e0-980c5baad924 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:46.948785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:46.952293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:46.952293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:46.952293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:46.963201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:46.964700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:46.974838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 954/1884] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:47.219449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:47.234397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8c34-6d15-43ab-aa73-cc9a7b0fe960 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:47.243155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:47.243858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:47.244149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:47.244426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:47.351429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:47.353001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fd1f4-6dec-48bb-b6cc-15d8bb133200 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:47.392199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 931/1885] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:56.209006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:56.210508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:56.278417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc0329-f1b0-4715-9639-582da17e1e37 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:56.283361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:56.284232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:56.284523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:56.284804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] PATH_INFO: `/v3/users/8865c79381c6474db8a12181aa85d500` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:56.285998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8865c79381c6474db8a12181aa85d500)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:56.287953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:56.507403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8865c79381c6474db8a12181aa85d500'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:56.514676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8865c79381c6474db8a12181aa85d500'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:56.605582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8865c79381c6474db8a12181aa85d500'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:56.606381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8865c79381c6474db8a12181aa85d500'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:56.607285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8865c79381c6474db8a12181aa85d500'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:56.628631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 955/1886] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:56 2022] DELETE /identity/v3/users/8865c79381c6474db8a12181aa85d500 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:56.633150 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:56.633687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:56.634299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:56.652997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:56.654784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:56.720874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 932/1887] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:37:56.731944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:56.733428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:56.795955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf28916-0a18-4591-95d1-c7db35025f67 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:56.800265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:56.800983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:56.801331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:56.801678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:56.811074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:56.812817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:56.823154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 956/1888] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:37:57.395530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:57.396948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:57.408858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeead1a-2cea-447e-be06-941905b5dd49 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:57.416201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:57.417072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:57.417353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:57.417636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] PATH_INFO: `/v3/projects/b88bb067945043ec89a1661d0992207d` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:57.418883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88bb067945043ec89a1661d0992207d)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:57.420739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:57.533719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88bb067945043ec89a1661d0992207d', 'request_id': 'req-2dc3450a-ffec-4443-be58-12cbae3a9206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.540038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88bb067945043ec89a1661d0992207d', 'request_id': 'req-2dc3450a-ffec-4443-be58-12cbae3a9206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.545471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88bb067945043ec89a1661d0992207d', 'request_id': 'req-2dc3450a-ffec-4443-be58-12cbae3a9206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.622023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] The token cache is being invalidate because project b88bb067945043ec89a1661d0992207d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:57.622322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.622974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.624585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 933/1889] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:57 2022] DELETE /identity/v3/projects/b88bb067945043ec89a1661d0992207d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:57.629031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:57.638567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9eb20-5c97-45b6-8bb0-8ced4f092b37 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:57.697412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:57.698289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:57.698575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:57.698854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] PATH_INFO: `/v3/users/c6e849b404b74a1b91ccefba20e45d3d` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:57.700229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e849b404b74a1b91ccefba20e45d3d)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:57.702256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:57.976104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e849b404b74a1b91ccefba20e45d3d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:57.982700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e849b404b74a1b91ccefba20e45d3d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.070715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e849b404b74a1b91ccefba20e45d3d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.071390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e849b404b74a1b91ccefba20e45d3d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.072003 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e849b404b74a1b91ccefba20e45d3d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.090411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 957/1890] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:57 2022] DELETE /identity/v3/users/c6e849b404b74a1b91ccefba20e45d3d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:58.512005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:58.513639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:58.527367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3450a-ffec-4443-be58-12cbae3a9206 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:58.583791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:58.584671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:58.584951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:58.585224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] PATH_INFO: `/v3/projects/6b1cd2c7164c484e96276720aadcaca3` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:58.586382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1cd2c7164c484e96276720aadcaca3)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:58.588365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:58.701815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1cd2c7164c484e96276720aadcaca3', 'request_id': 'req-715fb886-5651-4fbd-adcb-f7373fb66ba0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.708385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1cd2c7164c484e96276720aadcaca3', 'request_id': 'req-715fb886-5651-4fbd-adcb-f7373fb66ba0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.715506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1cd2c7164c484e96276720aadcaca3', 'request_id': 'req-715fb886-5651-4fbd-adcb-f7373fb66ba0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.817214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] The token cache is being invalidate because project 6b1cd2c7164c484e96276720aadcaca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:58.817541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.818187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:58.819824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 934/1891] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:58 2022] DELETE /identity/v3/projects/6b1cd2c7164c484e96276720aadcaca3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:58.823830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:58.825221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:58.837513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d851a-1680-4160-ba75-1ad3ae53694b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:58.891035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:58.891940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:58.892228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:58.892505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] PATH_INFO: `/v3/users/a6cd76b8716f470bb1603dac38e7ff13` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:58.893735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cd76b8716f470bb1603dac38e7ff13)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:58.895687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:59.127655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cd76b8716f470bb1603dac38e7ff13'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.134268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cd76b8716f470bb1603dac38e7ff13'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.190710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cd76b8716f470bb1603dac38e7ff13'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.191377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cd76b8716f470bb1603dac38e7ff13'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.191979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bbc67bd7-e0b1-4e87-abbe-371595506be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cd76b8716f470bb1603dac38e7ff13'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.209373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 958/1892] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:37:58 2022] DELETE /identity/v3/users/a6cd76b8716f470bb1603dac38e7ff13 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:59.618605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:37:59.620341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:59.634648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-5651-4fbd-adcb-f7373fb66ba0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:37:59.690095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:37:59.690951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:59.691237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:59.691549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] PATH_INFO: `/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:59.692733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f5bafaedfa4a1482b5c560f18b61b9)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:37:59.694695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:37:59.825087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f5bafaedfa4a1482b5c560f18b61b9', 'request_id': 'req-610ec458-c348-47a3-bf96-1a995d94f7ef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.831742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f5bafaedfa4a1482b5c560f18b61b9', 'request_id': 'req-610ec458-c348-47a3-bf96-1a995d94f7ef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.836874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f5bafaedfa4a1482b5c560f18b61b9', 'request_id': 'req-610ec458-c348-47a3-bf96-1a995d94f7ef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.910857 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] The token cache is being invalidate because project 22f5bafaedfa4a1482b5c560f18b61b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:37:59.911145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.911806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-610ec458-c348-47a3-bf96-1a995d94f7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:37:59.913382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 935/1893] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:37:59 2022] DELETE /identity/v3/projects/22f5bafaedfa4a1482b5c560f18b61b9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:37:59.919460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:37:59.919916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:37:59.920055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:37:59.938567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:37:59.940616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:37:59.998245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 959/1894] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:00.007309 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.007615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.007897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.026368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:00.027597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:00.036276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 936/1895] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:00.040174 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.050005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef0a8-51e2-4480-9449-8fa80efb6807 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.054496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.055141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.055464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.055743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.056452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:00.056755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.058326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.070321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 960/1896] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:00.074542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.084554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471fd1c-495d-4cef-a61a-d9772961a569 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.089222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.089906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.090193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.090471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.091174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.093120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.186791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 937/1897] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:00 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:00.190999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.201063 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e7a09-c93d-41e1-ae72-91aedad31db2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.273023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.273696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.273982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.274264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.274955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.276904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.374371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 961/1898] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:00 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:00.375626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.386696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb7c1-18a0-49ed-b700-3be4405d9ef8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.391550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.392221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.392508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.392796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.393573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.395183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.406215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 938/1899] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:00.410389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.420536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767952b-28ae-4c2f-ab46-338199306862 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.425706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.426357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.426643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.426946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.427741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.429318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dd630-4deb-414d-b301-d4f9827687d5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.440005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 962/1900] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:00.443983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.453573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f59ea-cd35-4691-bbc1-ecce86759d1b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.458195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.459052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.459366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.459644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] PATH_INFO: `/v3/projects/9444d2ecf9d84cb4a08401df2c57cf8c/users/d1254e007b06484f802a6f74c705be5d/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.474297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9444d2ecf9d84cb4a08401df2c57cf8c, user_id=d1254e007b06484f802a6f74c705be5d, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.476953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.556814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 939/1901] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:00 2022] PUT /identity/v3/projects/9444d2ecf9d84cb4a08401df2c57cf8c/users/d1254e007b06484f802a6f74c705be5d/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:00.575028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.575513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.575802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.601997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] MFA Rules not processed for user `d1254e007b06484f802a6f74c705be5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:00.603190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:00.665550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 963/1902] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:00.676900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.678844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:00.735751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcba86-bc76-486a-8ad2-8d1fde06e795 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.740148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.740792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.741104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.741381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.749696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.751155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160da621-f580-44b6-947a-53a06fdc3dc0 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:00.759921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 940/1903] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:00.778823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:00.842456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9b70-6c4a-4064-b567-cf01e96ce258 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:00.848166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:00.848377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:00.848670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:00.848948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] PATH_INFO: `/v3/users/d1254e007b06484f802a6f74c705be5d` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:00.850175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1254e007b06484f802a6f74c705be5d)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:00.852135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:01.089784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1254e007b06484f802a6f74c705be5d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.096934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1254e007b06484f802a6f74c705be5d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.173159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1254e007b06484f802a6f74c705be5d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.174284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1254e007b06484f802a6f74c705be5d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.174930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1254e007b06484f802a6f74c705be5d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.192769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 964/1904] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:00 2022] DELETE /identity/v3/users/d1254e007b06484f802a6f74c705be5d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:01.197391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:01.197693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:01.197977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:01.215285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:01.216549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:01.280698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 941/1905] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:01.291470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:01.293073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:01.351034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147cbf0-2491-4f72-8731-a317439480bd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:01.354721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:01.355506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:01.355796 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:01.356071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:01.366405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:01.367914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e2b15-026b-4cd4-9d60-067447a985b7 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:01.378357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 965/1906] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:01.841448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:01.842940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:01.863275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4666e7-82e5-47ec-8f79-3f1e84d12e63 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:01.868283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:01.869179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:01.869462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:01.869737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] PATH_INFO: `/v3/projects/9444d2ecf9d84cb4a08401df2c57cf8c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:01.871154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9444d2ecf9d84cb4a08401df2c57cf8c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:01.873072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:01.987790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9444d2ecf9d84cb4a08401df2c57cf8c', 'request_id': 'req-e1725b02-853b-4eae-9f69-7686e919af1a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:01.994990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9444d2ecf9d84cb4a08401df2c57cf8c', 'request_id': 'req-e1725b02-853b-4eae-9f69-7686e919af1a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:02.000952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9444d2ecf9d84cb4a08401df2c57cf8c', 'request_id': 'req-e1725b02-853b-4eae-9f69-7686e919af1a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:02.079041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] The token cache is being invalidate because project 9444d2ecf9d84cb4a08401df2c57cf8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:02.079357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:02.080012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e1725b02-853b-4eae-9f69-7686e919af1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:02.081602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 942/1907] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:01 2022] DELETE /identity/v3/projects/9444d2ecf9d84cb4a08401df2c57cf8c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:02.090738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.092598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.092598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.113601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:02.115495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:02.175769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 966/1908] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:02.183603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.183979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.184352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.202714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:02.203948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:02.211973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 943/1909] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:02.216454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.227280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9648a-53ce-4c5a-b3f4-769c35d6c940 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.232117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.232779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.233068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.233350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.234130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:02.234441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.236749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.248459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 967/1910] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:02.253264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.262517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3fb792-752d-4fbe-9c35-75a17c8872dd None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.268354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.269081 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.269337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.269617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.270384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.272387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.346937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 944/1911] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:02.351234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.362844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1710b65-9f10-4a11-a74f-3e2dcbdb05c2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.427491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.428606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.428836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.429150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.429936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.432014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.542907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 968/1912] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:02 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:02.547224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.558367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9fa-cf3e-4237-9aaa-d2a98476af62 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.563005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.563701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.564043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.564322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.565068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.566839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.577553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 945/1913] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:02.582312 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.593306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f25634-d4c8-4cbe-b038-c6389621a561 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.599427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.600169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.600533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.605709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.605709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.605709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e94f00-91dd-4dd5-961c-10af025a7725 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.614127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 969/1914] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:02.618517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.628713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122907-a23a-459c-802d-0eb57a71f305 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.634008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.634897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.635186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.635673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] PATH_INFO: `/v3/projects/f25b7aa62a1c4dcf8539392e81ba5531/users/2fdd309710ba4c44b02a01a6b64eaacf/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.652195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25b7aa62a1c4dcf8539392e81ba5531, user_id=2fdd309710ba4c44b02a01a6b64eaacf, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.655327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.739931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 946/1915] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:02 2022] PUT /identity/v3/projects/f25b7aa62a1c4dcf8539392e81ba5531/users/2fdd309710ba4c44b02a01a6b64eaacf/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:02.750439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.750736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.751018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.780303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] MFA Rules not processed for user `2fdd309710ba4c44b02a01a6b64eaacf`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:02.781561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:02.842967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 970/1916] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:02.853125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:02.854736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:02.912465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8abe59-acdb-4963-9ea3-d35b580cb36c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:02.916198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:02.916883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:02.917175 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:02.917452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:02.927721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:02.929157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:02.937827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 947/1917] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:07.117699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:07.119237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.217999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e94e-1377-4e20-8958-61304905a875 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:07.223617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:07.224501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.224813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.225092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] PATH_INFO: `/v3/users/973e6a7e161540d598503f085521781e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.226306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973e6a7e161540d598503f085521781e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:07.228290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:07.354368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:07.365461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d683e56-bf7b-4356-8431-79d78bf8cb0c service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:07.370207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:07.371141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.371524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.371869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] PATH_INFO: `/v3/users/2fdd309710ba4c44b02a01a6b64eaacf` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.373157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdd309710ba4c44b02a01a6b64eaacf)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:07.375217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:07.396255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973e6a7e161540d598503f085521781e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.405754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973e6a7e161540d598503f085521781e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.473600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973e6a7e161540d598503f085521781e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.474317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973e6a7e161540d598503f085521781e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.475002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bd218365-1df0-457d-a1ee-fa4f5a832831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973e6a7e161540d598503f085521781e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.498924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 971/1918] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:07 2022] DELETE /identity/v3/users/973e6a7e161540d598503f085521781e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:07.504145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.504572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.504981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.522880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:07.524085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdd309710ba4c44b02a01a6b64eaacf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.524324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.531142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdd309710ba4c44b02a01a6b64eaacf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.588428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 972/1919] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:07.598850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:07.600274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.602486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdd309710ba4c44b02a01a6b64eaacf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.603387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdd309710ba4c44b02a01a6b64eaacf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.604097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-2d3f592d-b869-46f3-927e-d6ae5ade8a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdd309710ba4c44b02a01a6b64eaacf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:07.625122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 948/1920] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:07 2022] DELETE /identity/v3/users/2fdd309710ba4c44b02a01a6b64eaacf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:07.629547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.630021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.630500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.648695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:07.650320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.668303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924c9fb-5506-42a8-83d7-d528362ea3b7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:07.717837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 949/1921] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:07.726050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:07.726814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.727175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.727663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.729587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.738470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:07.740065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:07.743738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:07.747329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:07.753682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce3922-33dc-4faa-823a-311150a3af43 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:07.757954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:07.758799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:07.758930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 973/1922] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:07.759547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:07.759969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:07.771370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:07.773064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:07.784328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 950/1923] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:08.218988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:08.223366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:08.239472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86786b-424f-4697-8b49-dc195e212162 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:08.247162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:08.250681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:08.250681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:08.250681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] PATH_INFO: `/v3/projects/66b1d5b2b33e4b588e7eea3920e72afa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:08.251622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b1d5b2b33e4b588e7eea3920e72afa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:08.254749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:08.384521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b1d5b2b33e4b588e7eea3920e72afa', 'request_id': 'req-84eb534a-5019-4b1c-ad90-bdc90c611592'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.391385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b1d5b2b33e4b588e7eea3920e72afa', 'request_id': 'req-84eb534a-5019-4b1c-ad90-bdc90c611592'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.396742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b1d5b2b33e4b588e7eea3920e72afa', 'request_id': 'req-84eb534a-5019-4b1c-ad90-bdc90c611592'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.504805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:08.508510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:08.511984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] The token cache is being invalidate because project 66b1d5b2b33e4b588e7eea3920e72afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:08.512294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.513042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.523124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 974/1924] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:08 2022] DELETE /identity/v3/projects/66b1d5b2b33e4b588e7eea3920e72afa => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:08.524245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:08.525832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:08.535902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2912-37c4-41f8-a269-fd641af020c0 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:08.626726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb534a-5019-4b1c-ad90-bdc90c611592 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:08.632389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:08.633280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:08.633614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:08.634056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] PATH_INFO: `/v3/users/5e083c841c154c6e9d69a1b35a89c1ed` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:08.635406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e083c841c154c6e9d69a1b35a89c1ed)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:08.637562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:08.665422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:08.665946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:08.666561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:08.667028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] PATH_INFO: `/v3/projects/f25b7aa62a1c4dcf8539392e81ba5531` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:08.669148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25b7aa62a1c4dcf8539392e81ba5531)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:08.671075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:08.816360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25b7aa62a1c4dcf8539392e81ba5531', 'request_id': 'req-0ae76b91-51f2-451d-841c-8eee1c34e89c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.816577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e083c841c154c6e9d69a1b35a89c1ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.822858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25b7aa62a1c4dcf8539392e81ba5531', 'request_id': 'req-0ae76b91-51f2-451d-841c-8eee1c34e89c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.828232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25b7aa62a1c4dcf8539392e81ba5531', 'request_id': 'req-0ae76b91-51f2-451d-841c-8eee1c34e89c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.835400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e083c841c154c6e9d69a1b35a89c1ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.911231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] The token cache is being invalidate because project f25b7aa62a1c4dcf8539392e81ba5531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:08.911486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.920109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0ae76b91-51f2-451d-841c-8eee1c34e89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.920109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 951/1925] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:08 2022] DELETE /identity/v3/projects/f25b7aa62a1c4dcf8539392e81ba5531 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:08.920109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213112-9523-4b16-8e36-363c7cff5140 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:08.920415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213112-9523-4b16-8e36-363c7cff5140 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:08.920486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63213112-9523-4b16-8e36-363c7cff5140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:08.942779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-63213112-9523-4b16-8e36-363c7cff5140 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:08.944063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-63213112-9523-4b16-8e36-363c7cff5140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:08.994073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e083c841c154c6e9d69a1b35a89c1ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.994745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e083c841c154c6e9d69a1b35a89c1ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:08.995410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e083c841c154c6e9d69a1b35a89c1ed'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.003251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 952/1926] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:09.012023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7878-de76-443e-9511-30d091355159 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.012313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7878-de76-443e-9511-30d091355159 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.012769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d7878-de76-443e-9511-30d091355159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.015427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 975/1927] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:08 2022] DELETE /identity/v3/users/5e083c841c154c6e9d69a1b35a89c1ed => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:09.032530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a59d7878-de76-443e-9511-30d091355159 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:09.033829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a59d7878-de76-443e-9511-30d091355159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.097989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 953/1928] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:09.099326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.109508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b483b19-8c63-452f-b041-c8748e02d25c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.114681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.115245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.115578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.115858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.116582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:09.116891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.118477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.130683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 976/1929] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:09.135102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d7878-de76-443e-9511-30d091355159 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.145357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d7878-de76-443e-9511-30d091355159 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.150102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.150753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.151036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.151339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.152029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.153999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.274953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 954/1930] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:09.280146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.291951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dc457-0fab-4c46-a415-db15f00ee693 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.347714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.348384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.348672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.348951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.349631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.351581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.441121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.442850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.456615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c8cb9-30a0-4b4e-9bc8-1af4db4bc537 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.463701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.464562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.464841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.465120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] PATH_INFO: `/v3/projects/6104145b072043b1acc1aa5078cfa1e2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.466372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6104145b072043b1acc1aa5078cfa1e2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.471673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 977/1931] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:09.472227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.473220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.483257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575abf-9794-4a15-9f86-38159b43d157 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.488110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.488771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.489100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.489382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.490105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.491799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.501731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 978/1932] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:09.505605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.515656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723913c8-9e62-422a-9c1b-7b7eac647033 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.520931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.521582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.521869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.522149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.522864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.524483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.535830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 979/1933] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:09.540738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.549979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef5005-4dc5-4ee2-b4fe-3fcaca6da4e2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.554568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.555466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.555792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.556090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] PATH_INFO: `/v3/projects/cfe82f70227446d2bfef0a3eba4578b0/users/ef1d14254a434c9890be60197e46571a/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.571635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe82f70227446d2bfef0a3eba4578b0, user_id=ef1d14254a434c9890be60197e46571a, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.574426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772b166-f6b6-4412-a581-c283d2389322 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.588181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6104145b072043b1acc1aa5078cfa1e2', 'request_id': 'req-5390bea8-aad7-4007-bbfe-654d7d0a3a48'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.594609 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6104145b072043b1acc1aa5078cfa1e2', 'request_id': 'req-5390bea8-aad7-4007-bbfe-654d7d0a3a48'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.600385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6104145b072043b1acc1aa5078cfa1e2', 'request_id': 'req-5390bea8-aad7-4007-bbfe-654d7d0a3a48'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.662644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 980/1934] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:09 2022] PUT /identity/v3/projects/cfe82f70227446d2bfef0a3eba4578b0/users/ef1d14254a434c9890be60197e46571a/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:09.672840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.673136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.673430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.687519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] The token cache is being invalidate because project 6104145b072043b1acc1aa5078cfa1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:09.688109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.689359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5390bea8-aad7-4007-bbfe-654d7d0a3a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:09.691085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 955/1935] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:09 2022] DELETE /identity/v3/projects/6104145b072043b1acc1aa5078cfa1e2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:09.696008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f06c-c8d8-4bd4-a34c-f30326b88fbc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.696236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f06c-c8d8-4bd4-a34c-f30326b88fbc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.696516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8f06c-c8d8-4bd4-a34c-f30326b88fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.707173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] MFA Rules not processed for user `ef1d14254a434c9890be60197e46571a`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:09.709289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.720931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ebd8f06c-c8d8-4bd4-a34c-f30326b88fbc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:09.722935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ebd8f06c-c8d8-4bd4-a34c-f30326b88fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.785543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 956/1936] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:09.789206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 981/1937] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:09.794378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.794751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.795122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.798912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.800873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.814936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:09.816346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:09.824403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 957/1938] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:09.828619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.837587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e9da1-2cab-48a9-b248-6401b5c20b5e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.842637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.843323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.843635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.843897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.844670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:09.845505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.847121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.859161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 958/1939] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:09.860345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7c0a4-bdf7-45a7-9085-9f392515944c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.863577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:09.866293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.867091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.867411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.867689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.875027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71b47-23ad-4da5-9a00-264289245fde admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:09.877361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.878836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.880792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:09.881605 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:09.882055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:09.882335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:09.883053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:09.884976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:09.887812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 982/1940] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:10.035675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 959/1941] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:10.039955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.051515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201832ee-ee3a-4ae0-83e8-7c2ac322d9ac service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.106631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.107391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.107683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.107964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.108658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.111131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.199437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 983/1942] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:10 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:10.203487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.213728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c8bf-fe15-4d22-a672-d41745a8b3b7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.218477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.219137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.219468 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.219753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.220505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.222621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.232405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 960/1943] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:10.236993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.247096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a166360-94f1-4255-a3f6-d14f5ad43bf3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.252524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.253176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.253458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.253734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.254447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.256072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5885-f1d5-4ba8-94f0-6b1fa2fc1c9c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.265787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 984/1944] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:10.269861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.280073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b7e-07dd-4449-9eca-248c2b5a1d19 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.284783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.285775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.288113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.288113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] PATH_INFO: `/v3/projects/6a44942b4cf64b9e9f9268268d8fc9f2/users/083e1878f72646d8aae2fd9f27f63dc5/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.301492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a44942b4cf64b9e9f9268268d8fc9f2, user_id=083e1878f72646d8aae2fd9f27f63dc5, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.304189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.365254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 961/1945] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:10 2022] PUT /identity/v3/projects/6a44942b4cf64b9e9f9268268d8fc9f2/users/083e1878f72646d8aae2fd9f27f63dc5/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:10.375475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.375945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.376086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.403226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] MFA Rules not processed for user `083e1878f72646d8aae2fd9f27f63dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:10.404757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:10.467004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 985/1946] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:10.471463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.541355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd50fb-c9f7-4064-a142-5b8a1544a0bf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.546098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.546762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.547053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.547368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.548099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.550003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.655527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 962/1947] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:10 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:10.659840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.670264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a980-1355-4bfd-b74b-b4b7a77ec0b0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.724727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.725346 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.725716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.726001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.726701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.728657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.831822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 986/1948] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:10 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:10.835624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.846373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d118d2a-5d0f-4834-8288-63c6dfdedcb9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.850972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.851668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.851978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.852241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.852972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.854585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:10.865707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 963/1949] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:10.869884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:10.880691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c619-84a5-4b2d-8e98-962eb4ad1d2c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:10.885975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:10.887034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:10.887341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:10.887629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] PATH_INFO: `/v3/projects/24d5ccc73e5e473881c543cda8a42174/users/865f9377cdb44149b687a4b57542efdb/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:10.904833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d5ccc73e5e473881c543cda8a42174, user_id=865f9377cdb44149b687a4b57542efdb, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:10.908188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:11.016196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 987/1950] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:10 2022] PUT /identity/v3/projects/24d5ccc73e5e473881c543cda8a42174/users/865f9377cdb44149b687a4b57542efdb/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:11.017939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:11.028592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48e76-04b7-45ca-b254-aa4be4f2586b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:11.088591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:11.093002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.093002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.093002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.093002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:11.093002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2bbba-36a7-4dbe-b188-69e83fb5c2b2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:11.102448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 964/1951] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:11.106574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:11.117066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a81b7-60b9-4ecb-82a8-4c96b1d23aa6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:11.121631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:11.122499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.122830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.123177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] PATH_INFO: `/v3/projects/24d5ccc73e5e473881c543cda8a42174/users/865f9377cdb44149b687a4b57542efdb/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.125200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d5ccc73e5e473881c543cda8a42174, user_id=865f9377cdb44149b687a4b57542efdb, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:11.128541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:11.138544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 988/1952] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:11 2022] PUT /identity/v3/projects/24d5ccc73e5e473881c543cda8a42174/users/865f9377cdb44149b687a4b57542efdb/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:11.149535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.149829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.150112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.175829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] MFA Rules not processed for user `865f9377cdb44149b687a4b57542efdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:11.177030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:11.244430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 965/1953] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:11.254632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:11.256357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:11.312434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0190e-318c-4fa9-8c48-f263d85ba177 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:11.316664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:11.317303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.317587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.317865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.326879 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:11.328343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfa87a-2a73-46e9-a79e-9fea59270bc8 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:11.338483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 989/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:11.364572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:11.424282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839d21d-9767-4401-b8fe-c59ff51c4205 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:11.428944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:11.429803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.430090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.430370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] PATH_INFO: `/v3/users/083e1878f72646d8aae2fd9f27f63dc5` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.431623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=083e1878f72646d8aae2fd9f27f63dc5)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:11.433548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:11.670250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083e1878f72646d8aae2fd9f27f63dc5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:11.677063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083e1878f72646d8aae2fd9f27f63dc5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:11.785179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083e1878f72646d8aae2fd9f27f63dc5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:11.786057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083e1878f72646d8aae2fd9f27f63dc5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:11.786765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083e1878f72646d8aae2fd9f27f63dc5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:11.812594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 966/1955] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:11 2022] DELETE /identity/v3/users/083e1878f72646d8aae2fd9f27f63dc5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:11.820091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.820600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.821093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:11.848917 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:11.850302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:11.913080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 990/1956] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:11.925269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:11.926754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:11.985608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96f193-ac61-4058-ac66-67237a6b99ec admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:11.990019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:11.990707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:11.990993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:11.991269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:12.000665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:12.002133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:12.011489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 967/1957] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:12.427521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:12.429238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:12.443359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6dd09-f9fd-4219-9591-4f1412127643 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:12.449526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:12.451033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:12.451610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:12.451931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] PATH_INFO: `/v3/projects/6a44942b4cf64b9e9f9268268d8fc9f2` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:12.453965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a44942b4cf64b9e9f9268268d8fc9f2)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:12.457041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:12.554840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a44942b4cf64b9e9f9268268d8fc9f2', 'request_id': 'req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:12.561361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a44942b4cf64b9e9f9268268d8fc9f2', 'request_id': 'req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:12.567261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a44942b4cf64b9e9f9268268d8fc9f2', 'request_id': 'req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:12.672180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] The token cache is being invalidate because project 6a44942b4cf64b9e9f9268268d8fc9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:12.672479 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:12.673209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:12.680368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 991/1958] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:12 2022] DELETE /identity/v3/projects/6a44942b4cf64b9e9f9268268d8fc9f2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:12.685810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:12.702032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986287f1-75bc-4241-99f9-1bbada2a503d service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:12.786154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:12.786680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:12.786973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:12.787252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] PATH_INFO: `/v3/users/865f9377cdb44149b687a4b57542efdb` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:12.788595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865f9377cdb44149b687a4b57542efdb)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:12.790602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:13.014343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865f9377cdb44149b687a4b57542efdb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.026367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865f9377cdb44149b687a4b57542efdb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.096936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865f9377cdb44149b687a4b57542efdb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.097576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865f9377cdb44149b687a4b57542efdb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.098244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-23623a69-e143-43c7-84a5-1fdcc839f228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865f9377cdb44149b687a4b57542efdb'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.119220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 968/1959] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:12 2022] DELETE /identity/v3/users/865f9377cdb44149b687a4b57542efdb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:13.624348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:13.626743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:13.645840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb34b9-2d6b-4ecc-b77d-1271ff573453 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:13.708085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:13.709237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:13.709719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:13.710165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] PATH_INFO: `/v3/projects/24d5ccc73e5e473881c543cda8a42174` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:13.711847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d5ccc73e5e473881c543cda8a42174)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:13.713999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:13.849956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d5ccc73e5e473881c543cda8a42174', 'request_id': 'req-54ff7aed-a855-4ebb-b05d-30606828bc64'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.856470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d5ccc73e5e473881c543cda8a42174', 'request_id': 'req-54ff7aed-a855-4ebb-b05d-30606828bc64'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.862781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d5ccc73e5e473881c543cda8a42174', 'request_id': 'req-54ff7aed-a855-4ebb-b05d-30606828bc64'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.927762 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] The token cache is being invalidate because project 24d5ccc73e5e473881c543cda8a42174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:13.928067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.928730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-54ff7aed-a855-4ebb-b05d-30606828bc64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:13.930303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 992/1960] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:13 2022] DELETE /identity/v3/projects/24d5ccc73e5e473881c543cda8a42174 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:13.935387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:13.935858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:13.935972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:13.956352 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:13.957573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.022988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 969/1961] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:14.032342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.033276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.033726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.052468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:14.053761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.061904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 993/1962] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:14.066059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.076176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db9aa-ff9c-44a5-8b75-12fbebb778d6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.082731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.083475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.083764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.084049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.084913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:14.085232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.085719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.086927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.087112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.099732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 970/1963] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:14.101145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bac6-4433-42a9-a628-4eb4186c65c9 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.103874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.107136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.108280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.108647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.108776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] PATH_INFO: `/v3/users/ef1d14254a434c9890be60197e46571a` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.110039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1d14254a434c9890be60197e46571a)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.111902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.115493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f35a4-4f02-41e5-b456-182674425325 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.121256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.122069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.122357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.122634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.123466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.126774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.232490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 971/1964] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:14 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:14.233323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.234988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.298780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f625e9-ec38-4af8-85c6-d3c37949158d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.303467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.304332 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.304612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.304885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] PATH_INFO: `/v3/users/d0550489a75240668137d248fd3714ff` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.306066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0550489a75240668137d248fd3714ff)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.308149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.322400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1d14254a434c9890be60197e46571a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.334224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1d14254a434c9890be60197e46571a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.459870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1d14254a434c9890be60197e46571a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.460927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1d14254a434c9890be60197e46571a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.461795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1d14254a434c9890be60197e46571a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.483900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 994/1965] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:14 2022] DELETE /identity/v3/users/ef1d14254a434c9890be60197e46571a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:14.484959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.488002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.543956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0550489a75240668137d248fd3714ff'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.552360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0550489a75240668137d248fd3714ff'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.561184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176aa84-fac5-4ecc-ae54-99bcc1d230d9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.574614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.575355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.575657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.575935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.576850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.579174 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.647855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0550489a75240668137d248fd3714ff'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.648489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0550489a75240668137d248fd3714ff'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.649837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1ad3b783-d6f1-4283-a2a7-e1f401388dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0550489a75240668137d248fd3714ff'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:14.669034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 972/1966] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:14 2022] DELETE /identity/v3/users/d0550489a75240668137d248fd3714ff => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:14.670403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.670814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.671197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.689765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:14.691066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.724513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 995/1967] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:14 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:14.728659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.730502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.744537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc5a29-b759-4f7a-846f-dde171b8c23b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.764336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 973/1968] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:14.777762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.780702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:14.814523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.815343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.815478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.815730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.816460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.818060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.829222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 996/1969] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:14.833839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.844676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5253-351c-4b22-a3aa-5c403d0df46f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.848069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ecb29-4310-4c82-893f-10bdafe83383 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.850144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.851027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.851574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.852042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.852229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.852851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.853133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.853407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.853719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.855530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.864319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.866602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:14.870528 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 997/1970] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:14.871591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:14.878805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 974/1971] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:14.882710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cd4b6-3552-4f8a-8165-efdd220d8c98 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:14.888140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:14.889294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:14.889713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:14.890594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] PATH_INFO: `/v3/projects/9ece5cdad4ce44f683f1d93e0ce1166c/users/d76abb0ad57941708aa01d5bff388133/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:14.906958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ece5cdad4ce44f683f1d93e0ce1166c, user_id=d76abb0ad57941708aa01d5bff388133, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:14.910233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215d4e-7a82-4da1-8352-6b9555fb38b5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.026882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.028374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.030360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 998/1972] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:14 2022] PUT /identity/v3/projects/9ece5cdad4ce44f683f1d93e0ce1166c/users/d76abb0ad57941708aa01d5bff388133/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:15.041670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c7d3c-5c1d-4691-9c97-cce2c5c92438 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.045505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ca45-0494-4883-981a-17881d9858fc None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.045807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ca45-0494-4883-981a-17881d9858fc None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.046179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ca45-0494-4883-981a-17881d9858fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.075956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c009ca45-0494-4883-981a-17881d9858fc None None] MFA Rules not processed for user `d76abb0ad57941708aa01d5bff388133`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:15.077415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c009ca45-0494-4883-981a-17881d9858fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.104363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.105788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.106773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.107229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] PATH_INFO: `/v3/projects/a42797fd39f04069893c3d64f19d2f7c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.108678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42797fd39f04069893c3d64f19d2f7c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.111371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.155412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 999/1973] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:15.161322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ca45-0494-4883-981a-17881d9858fc None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.186590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ca45-0494-4883-981a-17881d9858fc None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.192282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.192991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.193277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.193551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.194461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.196424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.222963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42797fd39f04069893c3d64f19d2f7c', 'request_id': 'req-a1415795-8a2f-49e7-9b93-ce9d3be6a552'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.230191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42797fd39f04069893c3d64f19d2f7c', 'request_id': 'req-a1415795-8a2f-49e7-9b93-ce9d3be6a552'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.236523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42797fd39f04069893c3d64f19d2f7c', 'request_id': 'req-a1415795-8a2f-49e7-9b93-ce9d3be6a552'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.308626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1000/1974] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:15 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:15.312431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.339171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] The token cache is being invalidate because project a42797fd39f04069893c3d64f19d2f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:15.340744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.340744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.344904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 975/1975] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:15 2022] DELETE /identity/v3/projects/a42797fd39f04069893c3d64f19d2f7c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:15.346180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.348323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.380453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dbafc-4f91-4f93-bb5c-9bcc1feede8b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.385461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.386300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.387213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.387213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.387731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.389672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.413476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415795-8a2f-49e7-9b93-ce9d3be6a552 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.418233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.419100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.419418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.419698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] PATH_INFO: `/v3/users/86a4689d42f34e1c9237cd38e6c63479` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.420896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a4689d42f34e1c9237cd38e6c63479)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.422813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.494161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1001/1976] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:15 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:15.504871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.511616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.526329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0b9fd-9bc9-48cd-b834-aab6a3bc3f87 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.545442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.546344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.546706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.547121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.549167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.551094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.562221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1002/1977] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:15.577199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.587389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525938f-1bc5-448f-80e4-332c694e98a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.596173 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.603111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.603111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.603111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] PATH_INFO: `/v3/projects/f5571d7123ad431489b8aa9c3a7035d7/users/f1f58050be044f76a9c0b81e460f54e8/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.615709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5571d7123ad431489b8aa9c3a7035d7, user_id=f1f58050be044f76a9c0b81e460f54e8, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.618421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.672432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a4689d42f34e1c9237cd38e6c63479'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.679808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a4689d42f34e1c9237cd38e6c63479'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.703705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1003/1978] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:15 2022] PUT /identity/v3/projects/f5571d7123ad431489b8aa9c3a7035d7/users/f1f58050be044f76a9c0b81e460f54e8/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:15.704541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.707998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.773816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a4689d42f34e1c9237cd38e6c63479'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.774440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a4689d42f34e1c9237cd38e6c63479'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.775067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a4689d42f34e1c9237cd38e6c63479'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:15.797403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 976/1979] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:15 2022] DELETE /identity/v3/users/86a4689d42f34e1c9237cd38e6c63479 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:15.798998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.802556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.815790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb4c5b-c05c-4040-be6f-14ce8e125a5c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.903474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85683-dc89-4eb7-b23f-60904f9389de admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.903474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.903474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.903474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.903827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.903827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.903974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.903974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.904143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.904232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.904232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] PATH_INFO: `/v3/users/cb6038deb5004b54ba8bf67a04babada` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.913881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6038deb5004b54ba8bf67a04babada)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.918098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 977/1980] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:15.918098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:15.918293 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:15.919835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:15.935003 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68325c1-66a0-490e-8ed1-f7bc02ca844d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:15.940878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:15.942168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:15.942527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:15.942896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] PATH_INFO: `/v3/projects/cfe82f70227446d2bfef0a3eba4578b0` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:15.944320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe82f70227446d2bfef0a3eba4578b0)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:15.946423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.106278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6038deb5004b54ba8bf67a04babada'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.107873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe82f70227446d2bfef0a3eba4578b0', 'request_id': 'req-613c16f3-1814-41dd-8808-916ec29d76d1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.114185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6038deb5004b54ba8bf67a04babada'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.118477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe82f70227446d2bfef0a3eba4578b0', 'request_id': 'req-613c16f3-1814-41dd-8808-916ec29d76d1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.125210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe82f70227446d2bfef0a3eba4578b0', 'request_id': 'req-613c16f3-1814-41dd-8808-916ec29d76d1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.174447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6038deb5004b54ba8bf67a04babada'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.175373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6038deb5004b54ba8bf67a04babada'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.176188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6038deb5004b54ba8bf67a04babada'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.194459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1004/1981] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:15 2022] DELETE /identity/v3/users/cb6038deb5004b54ba8bf67a04babada => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.195284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.196656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.231409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] The token cache is being invalidate because project cfe82f70227446d2bfef0a3eba4578b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:16.231710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.232701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.238589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 978/1982] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:15 2022] DELETE /identity/v3/projects/cfe82f70227446d2bfef0a3eba4578b0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.239559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.240999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.266321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92643913-cb13-49da-bbb4-1f4442855557 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.272408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.273286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.273573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.273847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] PATH_INFO: `/v3/users/be6b095718684cda8db2861f560318b4` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.275112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6b095718684cda8db2861f560318b4)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.277126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.315350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c16f3-1814-41dd-8808-916ec29d76d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.320841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.321736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.322023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.322303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] PATH_INFO: `/v3/projects/f5571d7123ad431489b8aa9c3a7035d7/users/f1f58050be044f76a9c0b81e460f54e8/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.324323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5571d7123ad431489b8aa9c3a7035d7, user_id=f1f58050be044f76a9c0b81e460f54e8, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.327020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.338149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 979/1983] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:16 2022] PUT /identity/v3/projects/f5571d7123ad431489b8aa9c3a7035d7/users/f1f58050be044f76a9c0b81e460f54e8/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.338975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.340680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.405757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5550-9cc2-42d6-8b38-d61a97587037 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.410495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.411366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.411654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.411928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] PATH_INFO: `/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.413413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bf91f1a5c34a35ba5f4081b07f476b)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.415318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.484429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6b095718684cda8db2861f560318b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.491129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6b095718684cda8db2861f560318b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.536511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bf91f1a5c34a35ba5f4081b07f476b', 'request_id': 'req-e97d28db-d14d-4729-aab5-4898d21d093e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.542447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bf91f1a5c34a35ba5f4081b07f476b', 'request_id': 'req-e97d28db-d14d-4729-aab5-4898d21d093e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.542572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6b095718684cda8db2861f560318b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.543117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6b095718684cda8db2861f560318b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.543800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e29429b8-03e2-48e9-b0d9-851c36d69226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6b095718684cda8db2861f560318b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.548195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bf91f1a5c34a35ba5f4081b07f476b', 'request_id': 'req-e97d28db-d14d-4729-aab5-4898d21d093e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.561266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1005/1984] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:16 2022] DELETE /identity/v3/users/be6b095718684cda8db2861f560318b4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.562563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a968-47bb-40dd-a44b-432633996839 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.562839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a968-47bb-40dd-a44b-432633996839 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.563119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a968-47bb-40dd-a44b-432633996839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.581279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8987a968-47bb-40dd-a44b-432633996839 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.582482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8987a968-47bb-40dd-a44b-432633996839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.627533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] The token cache is being invalidate because project 58bf91f1a5c34a35ba5f4081b07f476b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:16.628105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.629910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e97d28db-d14d-4729-aab5-4898d21d093e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.631526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 980/1985] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:16 2022] DELETE /identity/v3/projects/58bf91f1a5c34a35ba5f4081b07f476b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.635100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4aa41-1032-417a-a915-d8fe101e8260 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.635100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4aa41-1032-417a-a915-d8fe101e8260 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.635100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4aa41-1032-417a-a915-d8fe101e8260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.641811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1006/1986] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:16.642724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a968-47bb-40dd-a44b-432633996839 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.644057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8987a968-47bb-40dd-a44b-432633996839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.655979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a968-47bb-40dd-a44b-432633996839 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.660464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-86b4aa41-1032-417a-a915-d8fe101e8260 None None] MFA Rules not processed for user `f1f58050be044f76a9c0b81e460f54e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.661340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.662334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-86b4aa41-1032-417a-a915-d8fe101e8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.662456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.662456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.662740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] PATH_INFO: `/v3/projects/e05c08b255664381a966f688586fc635` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.663970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05c08b255664381a966f688586fc635)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.665882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.735378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 981/1987] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:16.739547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790a6f-3ab8-4a28-9371-bda7b6ea20e6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.739547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790a6f-3ab8-4a28-9371-bda7b6ea20e6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.739547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790a6f-3ab8-4a28-9371-bda7b6ea20e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.755983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-17790a6f-3ab8-4a28-9371-bda7b6ea20e6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.757253 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-17790a6f-3ab8-4a28-9371-bda7b6ea20e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.769669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05c08b255664381a966f688586fc635', 'request_id': 'req-dfbd2435-6623-475d-85ee-ee9197be8013'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.776406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05c08b255664381a966f688586fc635', 'request_id': 'req-dfbd2435-6623-475d-85ee-ee9197be8013'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.782337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05c08b255664381a966f688586fc635', 'request_id': 'req-dfbd2435-6623-475d-85ee-ee9197be8013'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.815402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 982/1988] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:16.816555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6117f-2a13-41ad-9f32-abae9ab6064e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.816847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6117f-2a13-41ad-9f32-abae9ab6064e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.817119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6117f-2a13-41ad-9f32-abae9ab6064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.835324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4cc6117f-2a13-41ad-9f32-abae9ab6064e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.836522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4cc6117f-2a13-41ad-9f32-abae9ab6064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.851776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] The token cache is being invalidate because project e05c08b255664381a966f688586fc635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:16.851776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.851776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:16.852492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 983/1989] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:16.852662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1007/1990] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:16 2022] DELETE /identity/v3/projects/e05c08b255664381a966f688586fc635 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:16.852749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.852749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.852749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.852984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.853975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.866112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.867327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.880842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 984/1991] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:16.880842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:16.881384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.915525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd2435-6623-475d-85ee-ee9197be8013 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.919494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.922625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.922625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.922625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.922625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.938256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b492f1-6b63-4f3f-a4a1-92b2ea675b22 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:16.942547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:16.943207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.953604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.953604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.953604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:16.958223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.959706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f9cbc-3099-4a6e-958c-d2fd7bfcbc22 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.969526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 985/1992] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:16.970855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686469-33de-4245-93ee-51217ba31c06 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:16.973559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686469-33de-4245-93ee-51217ba31c06 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:16.973559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686469-33de-4245-93ee-51217ba31c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:16.992638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:16.993588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-99686469-33de-4245-93ee-51217ba31c06 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:16.994267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:16.994946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-99686469-33de-4245-93ee-51217ba31c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.011430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 986/1993] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:17.011648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1008/1994] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:17.011648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.011817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47d75-bad5-42b3-9189-83a158bc311c None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.011817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47d75-bad5-42b3-9189-83a158bc311c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.011817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b47d75-bad5-42b3-9189-83a158bc311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.025874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576c764-a70a-416b-a60e-f4cd0b61f01c service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.028741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c9b47d75-bad5-42b3-9189-83a158bc311c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:17.030588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c9b47d75-bad5-42b3-9189-83a158bc311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.031829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.032641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.033023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.033351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.034232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:17.034533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.036270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.040453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 987/1995] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:17.045345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.045345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.045577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.050192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1009/1996] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:17.050192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.061113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119a41-026b-42c8-b13f-7b0499f75af9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.067368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.068078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.068208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:17.068365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.068635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.069483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.069601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:17.069849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.071487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.100037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 988/1997] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:17.100037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.100260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1010/1998] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:17.100349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed7650-97b6-47b4-8e92-b65604462463 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.100349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.100349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.100349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.100673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.100673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.100673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.100905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.108706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ffd3-03f7-4952-82f0-6a638039e699 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.114260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.114905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.115191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.115498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.116180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.118056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.229548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 989/1999] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:17.231055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1011/2000] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:17.231617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.236404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.308033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783673c-f308-448c-abfe-2072257b2cd7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.312541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.313522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.313849 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.314134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.314945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.317090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.325911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff167095-4628-4539-bfda-28314b312ab1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.332634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.333380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.333693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.333940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.339985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:17.339985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.339985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.352793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 990/2001] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:17.352793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.361279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163778-15ae-4ed2-a0f8-7648ecd28cb3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.366884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.366884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.366884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.367158 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.367904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.369997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.432418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1012/2002] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:17.432418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.440099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c57d9a-e9af-48b8-ab72-c5eb54705060 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.445848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.446656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.446854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.447131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.447865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.449889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.456434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 991/2003] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:17.456434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.469221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53f143-a240-49a8-a695-649f9f7a5e49 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.474557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.475232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.475560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.475841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.476706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.478185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.489703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 992/2004] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:17.490435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.492136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.504439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac85f5f-b3ae-4b8b-84d0-c230a09b6d56 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.509119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.509963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.510250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.510527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] PATH_INFO: `/v3/projects/73ad18cfbba84d81b958da5528b6951f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.511743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ad18cfbba84d81b958da5528b6951f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.513629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.627724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1013/2005] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:17.627724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.688817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2701-587e-4fbc-9e70-01b8fc50decc admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.689978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ad18cfbba84d81b958da5528b6951f', 'request_id': 'req-b405e752-0673-417b-b214-ced5a4ca3cd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:17.696849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ad18cfbba84d81b958da5528b6951f', 'request_id': 'req-b405e752-0673-417b-b214-ced5a4ca3cd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:17.702194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ad18cfbba84d81b958da5528b6951f', 'request_id': 'req-b405e752-0673-417b-b214-ced5a4ca3cd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:17.743311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.744022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.744308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.744659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.745413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.747020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.756504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1014/2006] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:17.757423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.766455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ffba6-559c-4e2f-a805-c1b64716b6db admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.771565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.772184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.772470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.772746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.773435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.774974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.788655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1015/2007] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:17.788655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.795568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f0c22-53b2-4946-a095-bd8f776f47de admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.801603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.801603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.801603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.801603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.802159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.804081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.825948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] The token cache is being invalidate because project 73ad18cfbba84d81b958da5528b6951f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:17.826312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:17.827007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:17.828742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 993/2008] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:17 2022] DELETE /identity/v3/projects/73ad18cfbba84d81b958da5528b6951f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:17.830147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.831432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.844541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e752-0673-417b-b214-ced5a4ca3cd4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.849902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.850753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.851037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.851329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] PATH_INFO: `/v3/users/d76abb0ad57941708aa01d5bff388133` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.852515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76abb0ad57941708aa01d5bff388133)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.854415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.933606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1016/2009] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:17 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:17.934573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.936162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.947990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765802e1-b0bb-434b-a93c-e2ae935f0546 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.952673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.953313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.953598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.953873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:17.954591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:17.956322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:17.966683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1017/2010] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:17.967499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:17.969171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:17.985182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ae753-46a0-4ced-8374-d88ffeb530d3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:17.990499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:17.991408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:17.991694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:17.991996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] PATH_INFO: `/v3/projects/bd60e65f7e2f47d88c32db7316df6f1f/users/14c0bb6188294bca88f5f0bcd8dc41af/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.006202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd60e65f7e2f47d88c32db7316df6f1f, user_id=14c0bb6188294bca88f5f0bcd8dc41af, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.008855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.094618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76abb0ad57941708aa01d5bff388133'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.101696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76abb0ad57941708aa01d5bff388133'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.142396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1018/2011] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:17 2022] PUT /identity/v3/projects/bd60e65f7e2f47d88c32db7316df6f1f/users/14c0bb6188294bca88f5f0bcd8dc41af/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:18.142998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.144758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.182168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76abb0ad57941708aa01d5bff388133'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.182902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76abb0ad57941708aa01d5bff388133'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.183642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76abb0ad57941708aa01d5bff388133'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.201445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 994/2012] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:17 2022] DELETE /identity/v3/users/d76abb0ad57941708aa01d5bff388133 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:18.202171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.204384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.207055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44eeff-86d0-4bfb-951f-fc3098656bc5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.275516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf45dd-f3b6-4d66-8dc1-089ad1fa37ab admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.281376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.282386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.283471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.283895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.284764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.286554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.287487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.288444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.288740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.289110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] PATH_INFO: `/v3/users/1827d96381d94a0294f2b9e19f5a33e2` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.290260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1827d96381d94a0294f2b9e19f5a33e2)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.292238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.297754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 995/2013] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:18.299173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.302712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.317004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9813-8e97-46d6-a9fb-a6459301fbcb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.322806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.323854 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.324147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.324428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] PATH_INFO: `/v3/projects/91ac37267ed64621b5b16935cd73755a/users/4d37e209401e499dab95751d095239cf/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.340758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ac37267ed64621b5b16935cd73755a, user_id=4d37e209401e499dab95751d095239cf, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.343901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8207d-c4be-4bad-b6a8-570b40aeacca admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.422347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 996/2014] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:18 2022] PUT /identity/v3/projects/91ac37267ed64621b5b16935cd73755a/users/4d37e209401e499dab95751d095239cf/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:18.423735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da02d3-b040-4e4b-8803-87e8aa88cd1a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.424042 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da02d3-b040-4e4b-8803-87e8aa88cd1a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.424319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da02d3-b040-4e4b-8803-87e8aa88cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.451920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a5da02d3-b040-4e4b-8803-87e8aa88cd1a None None] MFA Rules not processed for user `14c0bb6188294bca88f5f0bcd8dc41af`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:18.453041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a5da02d3-b040-4e4b-8803-87e8aa88cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.470614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1827d96381d94a0294f2b9e19f5a33e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.478225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1827d96381d94a0294f2b9e19f5a33e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.521602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1827d96381d94a0294f2b9e19f5a33e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.522255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1827d96381d94a0294f2b9e19f5a33e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.522886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1827d96381d94a0294f2b9e19f5a33e2'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:18.523890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 997/2015] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:18.525188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73e15-bebd-46d6-9364-5136f123c91d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.525482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73e15-bebd-46d6-9364-5136f123c91d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.525764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e73e15-bebd-46d6-9364-5136f123c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.544860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d1e73e15-bebd-46d6-9364-5136f123c91d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:18.546062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d1e73e15-bebd-46d6-9364-5136f123c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.546888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1019/2016] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:18 2022] DELETE /identity/v3/users/1827d96381d94a0294f2b9e19f5a33e2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:18.550437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.550437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.620221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274fec-2c63-4824-822a-756c92bfa1f2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.627332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.628176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.628798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.629083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.630175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.631816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.634004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 998/2017] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:18.635462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.635849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.636222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.644091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1020/2018] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:18.647150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.648302 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.669391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] MFA Rules not processed for user `4d37e209401e499dab95751d095239cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:18.670952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.712533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ddb3-5a3f-4e69-9399-8f84191b0e3a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.716343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.716998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.717283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.717562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.719476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.739979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 999/2019] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:18.741116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.742633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.784051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.785667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.796635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1021/2020] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:18.797566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.802682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cf125-3d01-4a35-aa8d-996b2f5b76d2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.806860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.807725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.808295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.808759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.809380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d329-3889-4f7c-8ac6-d9572f18a703 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.814727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.815648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.816011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.816365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] PATH_INFO: `/v3/projects/9b878b52fbbb4769ba4874a1d1b46bb0/users/e67b95f4a25544f9b21c138de6f962c4/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.822034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.823696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.834364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1000/2021] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:18.834842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b878b52fbbb4769ba4874a1d1b46bb0, user_id=e67b95f4a25544f9b21c138de6f962c4, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.835765 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:18.837126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:18.837905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.850095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95acfcc-bae2-4737-84c9-3f808cbe2891 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:18.855270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:18.855972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.856373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.856575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.866580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:18.868658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26185759-4552-403a-92f3-8d6f4419c1e2 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:18.878766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1001/2022] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:18.932810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1022/2023] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:18 2022] PUT /identity/v3/projects/9b878b52fbbb4769ba4874a1d1b46bb0/users/e67b95f4a25544f9b21c138de6f962c4/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:18.944938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:18.945230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:18.945506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:18.978929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] MFA Rules not processed for user `e67b95f4a25544f9b21c138de6f962c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:18.980199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.065637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1002/2024] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:19.200477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.202604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.277750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb2ac-ddc7-4525-bb6c-f6f681081d2a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.283631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.284912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.284912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.285111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] PATH_INFO: `/v3/projects/dafa8a45ba9e45dea05683ed180ff64d` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.288581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafa8a45ba9e45dea05683ed180ff64d)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.288581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:19.401643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.403117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.412182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafa8a45ba9e45dea05683ed180ff64d', 'request_id': 'req-a297ab36-c1af-4cbb-8949-b42827d79230'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.417848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f09f-cf97-4b57-9818-aae3fa70d34c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.419039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafa8a45ba9e45dea05683ed180ff64d', 'request_id': 'req-a297ab36-c1af-4cbb-8949-b42827d79230'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.426238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafa8a45ba9e45dea05683ed180ff64d', 'request_id': 'req-a297ab36-c1af-4cbb-8949-b42827d79230'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.474613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.475454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.475745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.476031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] PATH_INFO: `/v3/projects/9ece5cdad4ce44f683f1d93e0ce1166c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.477278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ece5cdad4ce44f683f1d93e0ce1166c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.479205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:19.512942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] The token cache is being invalidate because project dafa8a45ba9e45dea05683ed180ff64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:19.513319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.515957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.522238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1023/2025] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:19 2022] DELETE /identity/v3/projects/dafa8a45ba9e45dea05683ed180ff64d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:19.522238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.523694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.586015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ab36-c1af-4cbb-8949-b42827d79230 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.589872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.590522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.590805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.591624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.593054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.630710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ece5cdad4ce44f683f1d93e0ce1166c', 'request_id': 'req-0d490bda-287c-4b34-bbd7-6544a076aaf4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.644506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ece5cdad4ce44f683f1d93e0ce1166c', 'request_id': 'req-0d490bda-287c-4b34-bbd7-6544a076aaf4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.650208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ece5cdad4ce44f683f1d93e0ce1166c', 'request_id': 'req-0d490bda-287c-4b34-bbd7-6544a076aaf4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.705609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.707096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2124f-86b1-4ee3-9efd-b5be2bb0077b service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:19.715940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1024/2026] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:19.717383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901ae7-4f8e-4042-8e34-4f4b7ea9e4e1 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.717656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901ae7-4f8e-4042-8e34-4f4b7ea9e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.717934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901ae7-4f8e-4042-8e34-4f4b7ea9e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.730840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] The token cache is being invalidate because project 9ece5cdad4ce44f683f1d93e0ce1166c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:19.731212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.732096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:19.733963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1003/2027] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:19 2022] DELETE /identity/v3/projects/9ece5cdad4ce44f683f1d93e0ce1166c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:19.736543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-93901ae7-4f8e-4042-8e34-4f4b7ea9e4e1 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:19.737733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-93901ae7-4f8e-4042-8e34-4f4b7ea9e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.743457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.745185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.823089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d490bda-287c-4b34-bbd7-6544a076aaf4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.826535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1025/2028] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:19.834351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.834839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.835141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.835453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.835602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.835842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.836145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] PATH_INFO: `/v3/users/f1f58050be044f76a9c0b81e460f54e8` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.837748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f58050be044f76a9c0b81e460f54e8)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.840221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:19.856901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:19.858131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:19.866244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1026/2029] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:19.870318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.879145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaaf9c-3fa1-48b9-a52f-587fcf3ec69d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.883986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.884614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.884903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.885180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.885887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:19.886195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.887826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:19.899716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1027/2030] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:19.903792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:19.914042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff7239-9205-4e3a-adc9-85fe77ed29eb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:19.918796 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:19.919467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:19.921585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:19.921585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:19.921585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:19.922586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.117558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1028/2031] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:20.121737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.152745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f58050be044f76a9c0b81e460f54e8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:20.160478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f58050be044f76a9c0b81e460f54e8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:20.182217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671449df-4656-4e28-b9d7-abe10a632eeb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.186944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.187704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.188005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.188282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.189471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.191447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.242128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f58050be044f76a9c0b81e460f54e8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:20.242855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f58050be044f76a9c0b81e460f54e8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:20.243513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f58050be044f76a9c0b81e460f54e8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:20.261680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1004/2032] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:19 2022] DELETE /identity/v3/users/f1f58050be044f76a9c0b81e460f54e8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:20.309197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1029/2033] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:20 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:20.310467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.311969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:20.376328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e4a3-04df-4229-8161-8fdf6b99cef6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.380850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.381520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.381808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.382085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.382807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.384446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.393907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1005/2034] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:20.397951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.408772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f2aff-bcd3-46dd-8d0e-1cace5ce9b2d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.413434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.414143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.414383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.414684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.415442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.417096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b45e0-dce5-496a-ad1d-da11a5644434 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.427481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1030/2035] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:20.432017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.441937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cae4b-4900-414f-90e0-78dc3fd566d6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.450874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.452016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.452523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.452733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] PATH_INFO: `/v3/projects/a42c85c7dab947d096e68cb89d077047/users/67d6bdfd4ae34ea5b95ca77154711cc4/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.480206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42c85c7dab947d096e68cb89d077047, user_id=67d6bdfd4ae34ea5b95ca77154711cc4, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.483617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.613224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1006/2036] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:20 2022] PUT /identity/v3/projects/a42c85c7dab947d096e68cb89d077047/users/67d6bdfd4ae34ea5b95ca77154711cc4/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:20.615232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.615655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.616093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.644083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] MFA Rules not processed for user `67d6bdfd4ae34ea5b95ca77154711cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:20.645597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:20.708794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.708794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:20.753506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1031/2037] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:20.758179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:20.834621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77e3b-e878-46e6-945d-d89b5ec469f9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.836802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c88a-1626-4342-aaf0-63b6e32a972a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:20.843057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.845931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.849119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.849401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:20.849532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.849532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.849695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:20.849695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:20.849695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] PATH_INFO: `/v3/projects/f5571d7123ad431489b8aa9c3a7035d7` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:20.850412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5571d7123ad431489b8aa9c3a7035d7)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:20.850582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:20.852592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.032906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1032/2038] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:20 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:21.036900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.078028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5571d7123ad431489b8aa9c3a7035d7', 'request_id': 'req-80f3a49b-58cf-4159-a9b5-fef61159a069'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:21.085379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5571d7123ad431489b8aa9c3a7035d7', 'request_id': 'req-80f3a49b-58cf-4159-a9b5-fef61159a069'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:21.097110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5571d7123ad431489b8aa9c3a7035d7', 'request_id': 'req-80f3a49b-58cf-4159-a9b5-fef61159a069'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:21.128079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970f3ea-3f07-42d6-951f-6f457ab63b18 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.185469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.186501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.186914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.187288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.188118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.190367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.194688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] The token cache is being invalidate because project f5571d7123ad431489b8aa9c3a7035d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:21.195089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:21.195966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80f3a49b-58cf-4159-a9b5-fef61159a069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:21.198658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1007/2039] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:20 2022] DELETE /identity/v3/projects/f5571d7123ad431489b8aa9c3a7035d7 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:21.203935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669536fc-5db9-4f18-ae35-962ba6b213eb None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.204441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669536fc-5db9-4f18-ae35-962ba6b213eb None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.204723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669536fc-5db9-4f18-ae35-962ba6b213eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.223277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-669536fc-5db9-4f18-ae35-962ba6b213eb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:21.224509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-669536fc-5db9-4f18-ae35-962ba6b213eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:21.238442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1008/2040] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:21.240330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.240626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.240902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.260450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:21.261775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:21.270577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1009/2041] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:21.274687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.283934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09e19-a45b-4558-ba70-b6b790695458 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.288565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.289194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.289480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.289761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.290473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:21.290781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.292430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.304139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1010/2042] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:21.308077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.317733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44139bf0-c7b7-4599-8be8-7a6f338b71d5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.322339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.322940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.323227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.323543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.324219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.326053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.340467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1033/2043] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:21.341522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.345547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:21.357201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb5d35-da26-469d-be15-b33215d2921b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.362415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.363092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.363416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.363853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.364576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.366160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.375728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1034/2044] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:21.380274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.390832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32dcba-0960-4029-82b5-9a9416ecefe9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.395519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.396143 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.399292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.399292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.399292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.399292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.410484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1035/2045] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:21.414578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.424634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f26bf-9940-40dc-a35f-b0b077d59034 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.429342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.430239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.430506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.430780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] PATH_INFO: `/v3/projects/fad5341c498247a49573221a1c6ee179/users/aaf75d2a065440caa713e4b9e41f629e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.445354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad5341c498247a49573221a1c6ee179, user_id=aaf75d2a065440caa713e4b9e41f629e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.448113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72af48a-6f23-4631-8e76-3e65ea852820 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.467526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1011/2046] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:21.469086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.530378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91be6e-303b-404c-8034-e26140e95cae admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.535535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.536218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.536509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.536792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.537490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.539579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.544720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1036/2047] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:21 2022] PUT /identity/v3/projects/fad5341c498247a49573221a1c6ee179/users/aaf75d2a065440caa713e4b9e41f629e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:21.552846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.553281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.553651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.582898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] MFA Rules not processed for user `aaf75d2a065440caa713e4b9e41f629e`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:21.584138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:21.648558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1037/2048] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:21.660251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1012/2049] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:21.665914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.666804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.680653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45dff-6a3b-4abd-91fd-b7f3ccb80b28 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.751067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ae1cc-5ae3-4fcd-a1eb-26c20f88a17f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.755730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.756403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.756693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.756976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.757707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.759547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.770701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1038/2050] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:21.774587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.784367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.785094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74dec-eb33-4a87-bbfc-54903a880ffb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.786418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.786972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.787319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.788059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.790141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.791742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.792706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.793147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.793588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.794429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.796111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.806819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1039/2051] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:21.810850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.821002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02040-fe3f-4aff-8860-7b5059962d28 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:21.826791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:21.826791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.826791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.827056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] PATH_INFO: `/v3/projects/6d825f1cb5644831a9f26e1cfa2eda24/users/3dbd8db7d6294a319b82f17407d552cb/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.842094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d825f1cb5644831a9f26e1cfa2eda24, user_id=3dbd8db7d6294a319b82f17407d552cb, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:21.844861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c8e2b-dbd6-4bd5-b1de-eb1ad773e1ff admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:21.930092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1013/2052] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:21.931091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:21.958375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1040/2053] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:21 2022] PUT /identity/v3/projects/6d825f1cb5644831a9f26e1cfa2eda24/users/3dbd8db7d6294a319b82f17407d552cb/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:21.968740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:21.969035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:21.969431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:21.999358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] MFA Rules not processed for user `3dbd8db7d6294a319b82f17407d552cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:22.000837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.014104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a32cd1-e043-470c-8cf7-1ca79e29d02d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.075268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.076006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.076790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.076790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.077008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1041/2054] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:22.077577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.080135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.089513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.089513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.144339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559d523-15d7-4f32-bfc4-0e5110efc127 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.148154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.148913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.149243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.149630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.158354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.159833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.168689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1042/2055] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:22.187664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.189414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1014/2056] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:21 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:22.195451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.198975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb5881-0994-4b32-a7f9-74288532c8dd service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.203756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.204606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.204887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.205160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] PATH_INFO: `/v3/users/3dbd8db7d6294a319b82f17407d552cb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.205755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa52638-2ff9-4399-b239-5b8c1f13c769 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.206365 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbd8db7d6294a319b82f17407d552cb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.208448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.210821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.211545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.211841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.212126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.212884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.214634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.224690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1015/2057] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:22.230142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.239898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef6416-277e-4eaf-b600-b17c7c8e6b1f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.244431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.245284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.245567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.245841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] PATH_INFO: `/v3/projects/2400d23c88c94fe2bd7887b031c33702/users/49d5b78722cb44349d0b405949dd76c1/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.261411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2400d23c88c94fe2bd7887b031c33702, user_id=49d5b78722cb44349d0b405949dd76c1, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.264212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.359245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1016/2058] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:22 2022] PUT /identity/v3/projects/2400d23c88c94fe2bd7887b031c33702/users/49d5b78722cb44349d0b405949dd76c1/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:22.363157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.424801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7855-04e1-4196-acfb-ccd36f974ce9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.429426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.430096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.430366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.430640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.431378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.433009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.443394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1017/2059] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:22.447674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.447826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbd8db7d6294a319b82f17407d552cb'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:22.455241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbd8db7d6294a319b82f17407d552cb'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:22.457912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c545-15e0-4d30-8e0d-72d4b365a8d5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.462910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.463808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.464095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.464373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] PATH_INFO: `/v3/projects/2400d23c88c94fe2bd7887b031c33702/users/49d5b78722cb44349d0b405949dd76c1/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.466337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2400d23c88c94fe2bd7887b031c33702, user_id=49d5b78722cb44349d0b405949dd76c1, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.469079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d60e9-445c-46d4-a32e-6b8fc86ff108 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.479629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1018/2060] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:22 2022] PUT /identity/v3/projects/2400d23c88c94fe2bd7887b031c33702/users/49d5b78722cb44349d0b405949dd76c1/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:22.490403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721311-92c2-4542-8092-bde821c3a92b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.490694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721311-92c2-4542-8092-bde821c3a92b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.490976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59721311-92c2-4542-8092-bde821c3a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.524226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-59721311-92c2-4542-8092-bde821c3a92b None None] MFA Rules not processed for user `49d5b78722cb44349d0b405949dd76c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:22.525433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-59721311-92c2-4542-8092-bde821c3a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.527559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbd8db7d6294a319b82f17407d552cb'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:22.528215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbd8db7d6294a319b82f17407d552cb'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:22.528831 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71785b06-8702-4019-b820-dc3b01a0bfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbd8db7d6294a319b82f17407d552cb'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:22.547436 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1043/2061] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:22 2022] DELETE /identity/v3/users/3dbd8db7d6294a319b82f17407d552cb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:22.552420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.552711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.552993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.569713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:22.570981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.596137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1019/2062] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:22.605583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721311-92c2-4542-8092-bde821c3a92b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.607021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-59721311-92c2-4542-8092-bde821c3a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.630703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1044/2063] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:22.640340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:22.641782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:22.663066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59721311-92c2-4542-8092-bde821c3a92b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.699678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128145dd-a7c8-417a-9ebc-41f525225a91 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:22.703314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.703973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.704288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.704567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.710579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:22.711396 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:22.711678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:22.711981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:22.713678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.715100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.724895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1045/2064] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:22.781711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:22.783986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa036-c331-4a2a-81bd-21180f829ff8 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:22.794235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1020/2065] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:23.270125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:23.272176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:23.285861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570c59-b840-4d8d-8478-06477ede641b service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:23.290983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:23.291909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.292192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.292475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] PATH_INFO: `/v3/projects/6d825f1cb5644831a9f26e1cfa2eda24` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.293663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d825f1cb5644831a9f26e1cfa2eda24)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:23.295623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:23.422603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d825f1cb5644831a9f26e1cfa2eda24', 'request_id': 'req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:23.431744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d825f1cb5644831a9f26e1cfa2eda24', 'request_id': 'req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:23.439922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d825f1cb5644831a9f26e1cfa2eda24', 'request_id': 'req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:23.524553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] The token cache is being invalidate because project 6d825f1cb5644831a9f26e1cfa2eda24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:23.525087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:23.525482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-5e036f6e-ebe3-4fb8-b71a-94feae8a2823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:23.527041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1046/2066] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:23 2022] DELETE /identity/v3/projects/6d825f1cb5644831a9f26e1cfa2eda24 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:23.532412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20528d0-222b-482f-8354-f799657466d9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.532830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20528d0-222b-482f-8354-f799657466d9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.533038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20528d0-222b-482f-8354-f799657466d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.555558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b20528d0-222b-482f-8354-f799657466d9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:23.556751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b20528d0-222b-482f-8354-f799657466d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:23.614420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1021/2067] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:23.623213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.623534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.623816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.642431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:23.643655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:23.651419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1047/2068] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:23.655876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20528d0-222b-482f-8354-f799657466d9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:23.665480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20528d0-222b-482f-8354-f799657466d9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:23.670182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:23.670841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.671129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.671453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.672186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:23.672542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:23.677634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:23.686101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1022/2069] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:23.691068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:23.700399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc74d-bb97-44ae-a9bf-539f302114b7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:23.705193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:23.705839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.706124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.706403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.707166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:23.709107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:23.798094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1048/2070] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:23 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:23.801264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:23.811896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa3ed7-99f6-48de-9bf3-477a5aa07f93 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:23.874910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:23.875615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.876426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.876710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.877416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:23.879369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:23.915255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:23.916977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:23.970590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3fcdf-0628-4c6b-9013-16a998435b60 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:23.974226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:23.974860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:23.975139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:23.975446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:23.977198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:24.005910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1023/2071] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:23 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:24.006890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.016320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04099c8-847b-4b74-af9d-bb61a256a371 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.021686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.022337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.022620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.022891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.023646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.025234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.034722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.035191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1024/2072] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:24.036176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.038976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.045725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1049/2073] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:24.048500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3a6e-6f06-4a11-bb51-009eaa2e5a57 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.053435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.054183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.054533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.054825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.055603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.057199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe90aa0-72c3-420d-98f7-4940a2be428f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.071243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1025/2074] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:24.072386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.083508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822bab-4c7b-42ba-a0cd-ab76eadc8974 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.088380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.089282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.089571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.089848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] PATH_INFO: `/v3/projects/9aff9f298943417aa43d7d2b3b7e83a5/users/d3a0349e347048bfb303f114ab351285/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.104392 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aff9f298943417aa43d7d2b3b7e83a5, user_id=d3a0349e347048bfb303f114ab351285, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.107055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.219207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1050/2075] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:24 2022] PUT /identity/v3/projects/9aff9f298943417aa43d7d2b3b7e83a5/users/d3a0349e347048bfb303f114ab351285/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:24.229289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.229638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.229927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.257945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] MFA Rules not processed for user `d3a0349e347048bfb303f114ab351285`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:24.259422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:24.323839 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1026/2076] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:24.328551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.395669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02f9fb-85be-465b-85ae-3edff1a48f2c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.401667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.402323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.402606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.403388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.403600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.412240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.491908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1051/2077] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:24 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:24.495885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.507096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad103f-f90d-4141-8166-495b81d06901 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.564495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.565166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.565451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.566382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.566540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.568466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.649157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1027/2078] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:24 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:24.652911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.663692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3aa54-ccd1-482c-9059-3de0eb0c6af7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.669075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.669891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.670190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.670466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.671195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.672836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.683285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1052/2079] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:24.687144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.698453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c88bb-dea3-408a-9477-1b2ad8e9bced admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.703149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.703855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.704757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.705061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.705795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.707433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837317f-69e1-4cd3-92bd-ab5258b8e8e8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.717808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1028/2080] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:24.722025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:24.731902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720026-21cc-4e88-a853-061184aa520a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:24.736868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:24.737750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.738067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.738345 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] PATH_INFO: `/v3/projects/d19edac120a0443ca7972a4986b95cd0/users/b94048b85792418ba539fe4741d24568/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.753871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19edac120a0443ca7972a4986b95cd0, user_id=b94048b85792418ba539fe4741d24568, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:24.756645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:24.856269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1053/2081] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:24 2022] PUT /identity/v3/projects/d19edac120a0443ca7972a4986b95cd0/users/b94048b85792418ba539fe4741d24568/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:24.869472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:24.869763 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:24.870043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:24.897013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] MFA Rules not processed for user `b94048b85792418ba539fe4741d24568`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:24.898242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:24.961160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1029/2082] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:24.965632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.026042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012f75-6437-466a-9cc1-7ab2374cdaf4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.031283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.032041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.032945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.039674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.039674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.039674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.137322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1054/2083] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:24 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:25.141329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.153410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5476473-36f8-47b5-9ca4-50ee7fb1efbc None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.222956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.223664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.223947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.224224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.224938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.226845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.310736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1030/2084] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:25 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:25.314860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.325227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bcdb-2dd1-4709-9611-5182252402a5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.330579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.331240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.331558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.331835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.332583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.334167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.344844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1055/2085] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:25.353453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.363172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25bfb5-c46b-447c-a9ae-b14148d3f723 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.367847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.368708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.368989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.369261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] PATH_INFO: `/v3/projects/a4ade873fa16474ca7a943822e66214a/users/e11bbf4a5a83452f8eed07743d4a1da4/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.383752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ade873fa16474ca7a943822e66214a, user_id=e11bbf4a5a83452f8eed07743d4a1da4, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.386374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.442725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1031/2086] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:25 2022] PUT /identity/v3/projects/a4ade873fa16474ca7a943822e66214a/users/e11bbf4a5a83452f8eed07743d4a1da4/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:25.446790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.463959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea8fca-6872-4e54-97b5-20aa561784c9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.523848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.524554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.524841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.525149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.525886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.527632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d3063-d74d-4d42-bda8-6955113173c7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.539123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1056/2087] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:25.543200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:25.560826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc497a-b6ce-45e2-8835-54a64ab88532 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:25.569100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:25.570168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.570461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.570875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] PATH_INFO: `/v3/projects/a4ade873fa16474ca7a943822e66214a/users/e11bbf4a5a83452f8eed07743d4a1da4/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.581271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ade873fa16474ca7a943822e66214a, user_id=e11bbf4a5a83452f8eed07743d4a1da4, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:25.583564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:25.598310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1032/2088] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:25 2022] PUT /identity/v3/projects/a4ade873fa16474ca7a943822e66214a/users/e11bbf4a5a83452f8eed07743d4a1da4/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:25.611107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:25.611447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:25.611731 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:25.641035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] MFA Rules not processed for user `e11bbf4a5a83452f8eed07743d4a1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:25.642288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:25.722788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1057/2089] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:26.021812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:26.075697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acb1fb-b75b-4eea-803b-a5d2796c3635 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:26.079975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:26.080614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:26.080895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:26.081169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:26.136282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:26.137722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:26.147360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1033/2090] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:30.842783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:30.855090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7cee5-47d2-4eee-ac3c-4f9e3b293bd5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:30.858938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:30.861607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:30.861607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:30.861607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:30.919582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:30.921027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:30.930842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1058/2091] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:32.815773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:32.824153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ddbdf-e3df-4387-805b-2eefa130ebc1 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:32.827764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:32.833751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:32.833751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:32.833751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:32.838369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:32.839835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:32.849621 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1034/2092] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:33.406716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:33.412702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3398-d811-4799-b82c-add64b56c381 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:33.416451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:33.417088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:33.417366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:33.417655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:33.419419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:33.481661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:33.483331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8109ad1-be6c-4a83-ae6c-a32689658170 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:33.492516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1059/2093] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:38.317940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:38.320569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:38.435908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ce354-34ff-41d1-a020-37f65f8f61d8 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:38.441129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:38.441988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:38.442277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:38.442557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] PATH_INFO: `/v3/users/e67b95f4a25544f9b21c138de6f962c4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:38.443793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67b95f4a25544f9b21c138de6f962c4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:38.445703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:38.667666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67b95f4a25544f9b21c138de6f962c4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:38.675817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67b95f4a25544f9b21c138de6f962c4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:38.773567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67b95f4a25544f9b21c138de6f962c4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:38.774291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67b95f4a25544f9b21c138de6f962c4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:38.774917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67b95f4a25544f9b21c138de6f962c4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:38.792805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1035/2094] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:38 2022] DELETE /identity/v3/users/e67b95f4a25544f9b21c138de6f962c4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:38.797294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:38.797750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:38.797863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:38.825468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:38.826679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:38.887114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1060/2095] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:38.894196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:38.895614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:38.994315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815788ec-a25f-4b23-a804-a9ea9f66e327 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:38.999311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.000016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.000467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.000748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.014571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.017297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.032406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1036/2096] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:39.141519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.142907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.155132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55de9-5a76-4937-8a5c-9b8605a39e81 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:39.159657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.167702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.167702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.167702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] PATH_INFO: `/v3/users/67d6bdfd4ae34ea5b95ca77154711cc4` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.167702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d6bdfd4ae34ea5b95ca77154711cc4)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.167702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.334868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d6bdfd4ae34ea5b95ca77154711cc4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.341574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d6bdfd4ae34ea5b95ca77154711cc4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.408936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.410414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.424843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe45f3-04c9-4463-b196-bd13c98439c4 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:39.429684 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.430523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.430806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.431082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] PATH_INFO: `/v3/projects/9b878b52fbbb4769ba4874a1d1b46bb0` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.431217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d6bdfd4ae34ea5b95ca77154711cc4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.431852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d6bdfd4ae34ea5b95ca77154711cc4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.432288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b878b52fbbb4769ba4874a1d1b46bb0)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.432650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-da335f6c-8a5c-4e33-8b80-d8be80fe4219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d6bdfd4ae34ea5b95ca77154711cc4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.434203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.452476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1061/2097] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:39 2022] DELETE /identity/v3/users/67d6bdfd4ae34ea5b95ca77154711cc4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:39.457121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.457417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.457698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.475681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:39.476884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.532966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b878b52fbbb4769ba4874a1d1b46bb0', 'request_id': 'req-1148df58-876b-4376-bc0e-b2d326918785'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.535460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1062/2098] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:39.539752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b878b52fbbb4769ba4874a1d1b46bb0', 'request_id': 'req-1148df58-876b-4376-bc0e-b2d326918785'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.545239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.545627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b878b52fbbb4769ba4874a1d1b46bb0', 'request_id': 'req-1148df58-876b-4376-bc0e-b2d326918785'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.546597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.602315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e459-60b6-4933-9b1d-b327912e293f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:39.643673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] The token cache is being invalidate because project 9b878b52fbbb4769ba4874a1d1b46bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:39.643960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.644571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1148df58-876b-4376-bc0e-b2d326918785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:39.646098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1037/2099] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:39 2022] DELETE /identity/v3/projects/9b878b52fbbb4769ba4874a1d1b46bb0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:39.648097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.648747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.649033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.649308 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.651127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.651246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.651497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.651726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.680492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:39.681720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.712617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.714069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee68c-1da6-406f-88d9-408ca372166f service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.724088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1063/2100] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:39.739432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1038/2101] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:39.747767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.748062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.748493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.765999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:39.767198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:39.775162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1064/2102] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:39.779535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.790136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f06df2-0e7c-4a96-b914-a3151653ff45 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:39.795043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.795733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.796019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.796299 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.797049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:39.797356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.798947 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.813863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1039/2103] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:39.815821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.825005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e904-16c8-4ff1-9262-85992c089141 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:39.829739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:39.830390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:39.831222 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:39.831663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:39.832354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:39.834250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:39.941435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1065/2104] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:39 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:39.942971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:39.959424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fdb57-df96-4c7b-9e5c-8d842a23ebbd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.018569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.020786 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.021538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.021538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.022056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.024030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.127715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1040/2105] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:39 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:40.135187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.146346 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6018f-5848-4634-8208-20409a599ddd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.151006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.151705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.151993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.152274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.153002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.154616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.157969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.160542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:40.166899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1066/2106] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:40.170736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.180740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014684c1-7fb5-4fb4-8f29-4e93d49326bb admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.186198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f32023-e0a2-4fdb-82a3-6479a0845b00 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.186795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.187777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.188192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.188587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.189449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.191203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.191457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.192199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.192481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.192758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] PATH_INFO: `/v3/projects/a42c85c7dab947d096e68cb89d077047` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.194539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42c85c7dab947d096e68cb89d077047)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.197194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.201559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1067/2107] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:40.206220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.215912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4ebcc-f43b-4050-859b-d34aaea54889 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.220842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.222331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.222618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.222899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] PATH_INFO: `/v3/projects/84c3acf1abc340ceb5387803ef54fd5a/users/042c8f164ee4482488c76819393fe57e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.238394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c3acf1abc340ceb5387803ef54fd5a, user_id=042c8f164ee4482488c76819393fe57e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.241115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b200-c319-4067-b9fc-d590e4f0f6b2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.316289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1068/2108] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:40 2022] PUT /identity/v3/projects/84c3acf1abc340ceb5387803ef54fd5a/users/042c8f164ee4482488c76819393fe57e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:40.323695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42c85c7dab947d096e68cb89d077047', 'request_id': 'req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.326140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.326428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.326709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.330296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42c85c7dab947d096e68cb89d077047', 'request_id': 'req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.336269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42c85c7dab947d096e68cb89d077047', 'request_id': 'req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.353378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] MFA Rules not processed for user `042c8f164ee4482488c76819393fe57e`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:40.354577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:40.396986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] The token cache is being invalidate because project a42c85c7dab947d096e68cb89d077047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:40.397276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.397943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.399722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1041/2109] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:40 2022] DELETE /identity/v3/projects/a42c85c7dab947d096e68cb89d077047 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:40.404183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.406354 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:40.417850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1069/2110] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:40.428445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.429835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:40.475457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cd27e-6e2b-4c46-a8d9-2ca0e8e75f29 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.480062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.480921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.481202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.481470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] PATH_INFO: `/v3/users/aaf75d2a065440caa713e4b9e41f629e` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.482646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf75d2a065440caa713e4b9e41f629e)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.484579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.503076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e2a1-7a98-4af3-9cd0-aa616ea765b8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.509574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.510352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.510772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.511132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.519860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.523382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.530443 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1070/2111] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:40.684261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf75d2a065440caa713e4b9e41f629e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.691541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf75d2a065440caa713e4b9e41f629e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.701461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:40.702908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:40.716462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40a44a-66cb-4e4f-a028-b2b3134c696f service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:40.721212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:40.722192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.722480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.722761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] PATH_INFO: `/v3/users/042c8f164ee4482488c76819393fe57e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:40.723978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=042c8f164ee4482488c76819393fe57e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:40.727232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:40.750391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf75d2a065440caa713e4b9e41f629e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.751030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf75d2a065440caa713e4b9e41f629e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.751668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-de7cd032-1c43-4093-a940-a0f79ff10b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf75d2a065440caa713e4b9e41f629e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.770663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1042/2112] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:40 2022] DELETE /identity/v3/users/aaf75d2a065440caa713e4b9e41f629e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:40.894909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042c8f164ee4482488c76819393fe57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.901461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042c8f164ee4482488c76819393fe57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.958722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042c8f164ee4482488c76819393fe57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.959393 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042c8f164ee4482488c76819393fe57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.960119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042c8f164ee4482488c76819393fe57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:40.981206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1071/2113] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:40 2022] DELETE /identity/v3/users/042c8f164ee4482488c76819393fe57e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:40.990214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:40.990214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:40.990214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.005563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:41.007144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:41.084747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1043/2114] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:41.094584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:41.096521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:41.154466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8871-0a50-433f-ad19-c52d8d82f0ed admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:41.158986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:41.159782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.160072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.160373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.169491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:41.170910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:41.182826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1072/2115] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:41.185984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:41.187420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:41.199957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3739a6-217b-4224-bac1-337c4bcd68ca None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:41.205115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:41.208177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.208177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.208177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] PATH_INFO: `/v3/projects/fad5341c498247a49573221a1c6ee179` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.215633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad5341c498247a49573221a1c6ee179)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:41.217612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:41.323844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad5341c498247a49573221a1c6ee179', 'request_id': 'req-10a91d53-3e6a-46d3-b076-0c4ac62febd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.329855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad5341c498247a49573221a1c6ee179', 'request_id': 'req-10a91d53-3e6a-46d3-b076-0c4ac62febd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.335180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad5341c498247a49573221a1c6ee179', 'request_id': 'req-10a91d53-3e6a-46d3-b076-0c4ac62febd4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.407246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] The token cache is being invalidate because project fad5341c498247a49573221a1c6ee179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:41.407571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.408245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.410323 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1044/2116] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:41 2022] DELETE /identity/v3/projects/fad5341c498247a49573221a1c6ee179 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:41.414232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:41.423852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2877b-ea50-4ebc-be2a-4cab2c65b960 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:41.479832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:41.480699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.480986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.481268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] PATH_INFO: `/v3/users/49d5b78722cb44349d0b405949dd76c1` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.482590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d5b78722cb44349d0b405949dd76c1)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:41.484582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:41.603527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:41.605055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:41.619985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91d53-3e6a-46d3-b076-0c4ac62febd4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:41.625663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:41.626528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.626815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.627092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] PATH_INFO: `/v3/projects/84c3acf1abc340ceb5387803ef54fd5a` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.628872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c3acf1abc340ceb5387803ef54fd5a)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:41.630887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:41.718131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d5b78722cb44349d0b405949dd76c1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.724947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d5b78722cb44349d0b405949dd76c1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.758930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c3acf1abc340ceb5387803ef54fd5a', 'request_id': 'req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.765184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c3acf1abc340ceb5387803ef54fd5a', 'request_id': 'req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.770658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c3acf1abc340ceb5387803ef54fd5a', 'request_id': 'req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.798246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d5b78722cb44349d0b405949dd76c1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.798878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d5b78722cb44349d0b405949dd76c1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.800048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-eef63a3d-bc35-4ba7-873c-296feae646f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d5b78722cb44349d0b405949dd76c1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.817664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1073/2117] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:41 2022] DELETE /identity/v3/users/49d5b78722cb44349d0b405949dd76c1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:41.870182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] The token cache is being invalidate because project 84c3acf1abc340ceb5387803ef54fd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:41.870536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.871184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dbe40c1e-b76d-4212-8d8b-bcef4e55e682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:41.872801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1045/2118] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:41 2022] DELETE /identity/v3/projects/84c3acf1abc340ceb5387803ef54fd5a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:41.877861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.878158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.878459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:41.907780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:41.909515 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:41.985254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1074/2119] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:41.993549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:41.993847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:41.994128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.013126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:42.014454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.024308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1046/2120] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:42.028592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.039279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac8c03-4df0-4f7b-b06a-f85938868546 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.044269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.045008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.045358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.045700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.046489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:42.046869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.048645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.062164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1075/2121] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:42.066491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.076294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd12a7-86fe-4cde-994f-e4e47b24021e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.082608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.083358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.083716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.084170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.084824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.086776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.169004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1047/2122] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:42.173230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.184127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb67bb-0610-40e6-955c-d0dbf7306e02 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.206018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.207783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.253311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.254001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.254278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.254566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.255316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.257212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.271890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c593b7-fd3f-401e-b5c5-e1ee32147e03 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.276721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.277584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.277866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.278139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] PATH_INFO: `/v3/projects/2400d23c88c94fe2bd7887b031c33702` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.279365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2400d23c88c94fe2bd7887b031c33702)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.281531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.347794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1076/2123] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:42.351647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.360979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba5e07-207b-4450-b118-e7bee95d7f7e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.365565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.366184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.366464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.366737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.367470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.369038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.378942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1077/2124] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:42.382907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.389535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2400d23c88c94fe2bd7887b031c33702', 'request_id': 'req-0bd5b31a-0058-4976-a382-6f87364110f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:42.392576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa22ef-745b-466e-bddf-aba8cf827435 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.396658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2400d23c88c94fe2bd7887b031c33702', 'request_id': 'req-0bd5b31a-0058-4976-a382-6f87364110f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:42.402244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2400d23c88c94fe2bd7887b031c33702', 'request_id': 'req-0bd5b31a-0058-4976-a382-6f87364110f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:42.447226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.448045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.448331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.448609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.449320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.450968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.460936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1078/2125] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:42.464993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.475250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0fdb8-1492-4224-8d8a-080a2580b49e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.480041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.480882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.481170 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.481454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] PATH_INFO: `/v3/projects/958639807d754449aced2da4c9e33baa/users/af6c03a7e7af4591996f074f95a320ef/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.496924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=958639807d754449aced2da4c9e33baa, user_id=af6c03a7e7af4591996f074f95a320ef, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.499582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954334dd-1a41-4ef0-866b-8c703ad4e3ce admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.515364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] The token cache is being invalidate because project 2400d23c88c94fe2bd7887b031c33702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:42.515662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:42.516310 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0bd5b31a-0058-4976-a382-6f87364110f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:42.518378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1048/2126] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:42 2022] DELETE /identity/v3/projects/2400d23c88c94fe2bd7887b031c33702 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:42.523999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d543c-ef54-430a-8e68-94e3c6087c15 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.524290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d543c-ef54-430a-8e68-94e3c6087c15 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.524590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d543c-ef54-430a-8e68-94e3c6087c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.542809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-db3d543c-ef54-430a-8e68-94e3c6087c15 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:42.544039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-db3d543c-ef54-430a-8e68-94e3c6087c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.552241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1049/2127] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:42.561342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81029680-c996-4751-b4e2-fb604b24192b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.561638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81029680-c996-4751-b4e2-fb604b24192b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.561919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81029680-c996-4751-b4e2-fb604b24192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.579533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-81029680-c996-4751-b4e2-fb604b24192b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:42.581414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-81029680-c996-4751-b4e2-fb604b24192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.589566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1050/2128] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:42.593640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81029680-c996-4751-b4e2-fb604b24192b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.602265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1079/2129] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:42 2022] PUT /identity/v3/projects/958639807d754449aced2da4c9e33baa/users/af6c03a7e7af4591996f074f95a320ef/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:42.603404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81029680-c996-4751-b4e2-fb604b24192b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.613546 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.613969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.614250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.639763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] MFA Rules not processed for user `af6c03a7e7af4591996f074f95a320ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:42.640981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.658360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.659043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.659340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.659618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.660325 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:42.660629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.662216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.677278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1051/2130] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:42.678501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.687917 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c4764-9ee7-4b91-8c03-8a6c2eeba5bd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.693019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.693654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.693942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.694223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.694938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.696887 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.702424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1080/2131] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:42.707354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.708750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:42.721769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32e2c-4ade-4d42-aff2-e44f8b68fa83 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.726347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.726985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.727266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.727572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.728248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.730142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.832252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1052/2132] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:42.836808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.862148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1081/2133] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:42.870311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:42.897123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5232def-b557-4638-8aae-3233238ab88f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.930592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e565d-0f42-457b-9e69-a306045d520a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:42.935451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.936248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.936544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.936826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.937647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.939584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:42.951534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:42.952220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:42.952593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:42.952874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:42.953563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:42.956116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.024716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1082/2134] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:43.028709 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.038872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac59e6-75d4-47fb-8802-3fd515541576 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.043552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.044183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.044473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.044751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.045472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.047150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.064155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1083/2135] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:43.068956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.075368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1053/2136] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:42 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:43.076427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.080717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb063c7-049f-4bb1-96a0-8bbdb9df8fdf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.086454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.087967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.088407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.088633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73fbf9-04b3-449d-a56a-ce6a38cc1a19 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.088780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] PATH_INFO: `/v3/projects/011ced718d854ed0be70c4c4b440ad3b/users/f724f9bbbf6747ac8753420df87f7a3f/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.095574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.096269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.098401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.098694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.099471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.101199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.105764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ced718d854ed0be70c4c4b440ad3b, user_id=f724f9bbbf6747ac8753420df87f7a3f, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.108474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.111308 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1054/2137] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:43.115610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.127223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d68654-3329-45e1-a407-51d25cbeab36 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.135487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.136375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.136735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.137092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.137943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.139829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.153407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1055/2138] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:43.162068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.172170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda9bb-8fb0-4018-bf4c-bb9ae799d6b5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.177565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.182251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.182251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.182251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] PATH_INFO: `/v3/projects/bfa29bc358244c07976267e757365346/users/1ee8301a31934e378517fad4993407ae/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.185687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1084/2139] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:43 2022] PUT /identity/v3/projects/011ced718d854ed0be70c4c4b440ad3b/users/f724f9bbbf6747ac8753420df87f7a3f/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:43.189809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.197049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa29bc358244c07976267e757365346, user_id=1ee8301a31934e378517fad4993407ae, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.199743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a2018-d669-4a8d-abe4-69a51f595d3c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.257048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c523c-e46a-402d-ae1e-ff06ecec4893 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.262273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.262967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.263428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.263716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.264445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.265579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1056/2140] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:43 2022] PUT /identity/v3/projects/bfa29bc358244c07976267e757365346/users/1ee8301a31934e378517fad4993407ae/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:43.266065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.277063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.277359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.277634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.278622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1085/2141] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:43.282869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.292597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4fbd-28ea-43c7-ac78-ba89d8920185 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.305128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] MFA Rules not processed for user `1ee8301a31934e378517fad4993407ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:43.306339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:43.347652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.348536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.348820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.349096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] PATH_INFO: `/v3/projects/011ced718d854ed0be70c4c4b440ad3b/users/f724f9bbbf6747ac8753420df87f7a3f/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.351047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ced718d854ed0be70c4c4b440ad3b, user_id=f724f9bbbf6747ac8753420df87f7a3f, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.353747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38238-3975-46b0-8fed-cee5f348d862 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.363816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1086/2142] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:43 2022] PUT /identity/v3/projects/011ced718d854ed0be70c4c4b440ad3b/users/f724f9bbbf6747ac8753420df87f7a3f/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:43.371911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1057/2143] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:43.374205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.374502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.374785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.376140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.386913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ada46-0537-4ff8-9309-02d9f2bc8f2d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.401574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] MFA Rules not processed for user `f724f9bbbf6747ac8753420df87f7a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:43.402775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:43.441569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.442230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.442517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.442793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.443516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.445568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.468949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1087/2144] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:43.479746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.481228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:43.536142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3ce5-ed9d-418c-86ca-0ba6881a3ef1 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.539804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.540440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.540723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.540997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.546703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1058/2145] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:43 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:43.547746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.558183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.558183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.561821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1088/2146] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:43.607997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4029-dd07-4fae-8b4d-0edc155c437e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.613312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.613974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.614294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.614572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.615257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.617313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.679341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1059/2147] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:43 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:43.683163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.693341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187717-9619-4271-9919-e021ac468c02 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.698321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.698973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.699254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.699564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.700353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.701970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.707145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.712797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1089/2148] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:43.716886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.727376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03973b1b-6c04-459d-b450-25b52b6a4c39 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.732038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.732893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.733176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.733456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] PATH_INFO: `/v3/projects/506d1180c5614dddb69893922698318e/users/133e7c42be8141d3bba3febef62667df/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.747729 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506d1180c5614dddb69893922698318e, user_id=133e7c42be8141d3bba3febef62667df, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.750367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.760223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af51a28-ab42-4834-9372-cfe14d86f2e9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.764613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.764613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.764973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.765176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.804488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1090/2149] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:43 2022] PUT /identity/v3/projects/506d1180c5614dddb69893922698318e/users/133e7c42be8141d3bba3febef62667df/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:43.808478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.819642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.821107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.830224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1060/2150] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:43.869079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a3ed7-768f-4728-a6dc-b3c824b0e290 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.873819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.874566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.874851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.875129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.875887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.877481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb7a-dd23-472e-9018-37296e671df4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.891048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1091/2151] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:43.891386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:43.902349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57efa96-a48b-4eba-9e90-baf53987b0d8 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:43.907280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:43.908179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.909444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.909724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] PATH_INFO: `/v3/projects/506d1180c5614dddb69893922698318e/users/133e7c42be8141d3bba3febef62667df/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.911733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506d1180c5614dddb69893922698318e, user_id=133e7c42be8141d3bba3febef62667df, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:43.914367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:43.924815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1061/2152] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:43 2022] PUT /identity/v3/projects/506d1180c5614dddb69893922698318e/users/133e7c42be8141d3bba3febef62667df/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:43.935042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:43.935539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:43.935650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:43.962754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] MFA Rules not processed for user `133e7c42be8141d3bba3febef62667df`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:43.963989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:44.029523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1092/2153] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:44.039471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:44.041227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:44.096699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737659df-cbb6-4971-8232-76e6d0004ca7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:44.100562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:44.101209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:44.101493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:44.101789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:44.111202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:44.112738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:44.124103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1062/2154] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:44.183086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:44.197110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bca65-58ce-41b2-b496-61ce286e7d4f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:44.201021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:44.201772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:44.202059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:44.202980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:44.262990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:44.262990 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed57f8-9675-466c-a509-34b7a58fa67c service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:44.272794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1093/2155] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:45.812810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:45.814296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:45.889349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095054fb-7964-48f1-a167-69be45891e73 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:45.894232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:45.895101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:45.895418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:45.895696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] PATH_INFO: `/v3/users/d3a0349e347048bfb303f114ab351285` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:45.896897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a0349e347048bfb303f114ab351285)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:45.898818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:46.138805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a0349e347048bfb303f114ab351285'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:46.145006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a0349e347048bfb303f114ab351285'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:46.218820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a0349e347048bfb303f114ab351285'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:46.219679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a0349e347048bfb303f114ab351285'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:46.220575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a0349e347048bfb303f114ab351285'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:46.239370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1063/2156] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:45 2022] DELETE /identity/v3/users/d3a0349e347048bfb303f114ab351285 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:46.244138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:46.244610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:46.244725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:46.262775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:46.264105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:46.326895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1094/2157] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:46.336460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:46.337957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:46.395623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ed810-31d2-46f7-8d3d-e6c7739286e7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:46.399606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:46.400266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:46.400554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:46.400831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:46.411072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:46.412593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:46.422343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1064/2158] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:46.982070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:46.983659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:47.001682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62257163-312a-44bc-91be-1b2c1aa77464 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:47.009303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:47.010705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:47.011088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:47.012315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] PATH_INFO: `/v3/projects/9aff9f298943417aa43d7d2b3b7e83a5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:47.013624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aff9f298943417aa43d7d2b3b7e83a5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:47.016722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:47.256544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aff9f298943417aa43d7d2b3b7e83a5', 'request_id': 'req-1145d972-6542-4341-9493-9b57ba71a3ab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.262773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aff9f298943417aa43d7d2b3b7e83a5', 'request_id': 'req-1145d972-6542-4341-9493-9b57ba71a3ab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.268444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aff9f298943417aa43d7d2b3b7e83a5', 'request_id': 'req-1145d972-6542-4341-9493-9b57ba71a3ab'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.549603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] The token cache is being invalidate because project 9aff9f298943417aa43d7d2b3b7e83a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:47.554625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.554625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.554625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1095/2159] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:46 2022] DELETE /identity/v3/projects/9aff9f298943417aa43d7d2b3b7e83a5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:47.557522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:47.566967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d138d-6832-4ce1-b388-0139b2c00d2d service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:47.622496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:47.623457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:47.623746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:47.624026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] PATH_INFO: `/v3/users/b94048b85792418ba539fe4741d24568` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:47.625219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94048b85792418ba539fe4741d24568)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:47.627262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:47.938524 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94048b85792418ba539fe4741d24568'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:47.946058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94048b85792418ba539fe4741d24568'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.019999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94048b85792418ba539fe4741d24568'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.022384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94048b85792418ba539fe4741d24568'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.022384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94048b85792418ba539fe4741d24568'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.039915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1065/2160] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:47 2022] DELETE /identity/v3/users/b94048b85792418ba539fe4741d24568 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:48.537389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:48.539079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:48.552995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d972-6542-4341-9493-9b57ba71a3ab admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:48.615543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:48.616337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:48.616628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:48.616945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] PATH_INFO: `/v3/projects/d19edac120a0443ca7972a4986b95cd0` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:48.618148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19edac120a0443ca7972a4986b95cd0)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:48.620091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:48.764860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19edac120a0443ca7972a4986b95cd0', 'request_id': 'req-944e91c3-e2cb-4007-919a-90a4f47f18f0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.771668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19edac120a0443ca7972a4986b95cd0', 'request_id': 'req-944e91c3-e2cb-4007-919a-90a4f47f18f0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.777518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19edac120a0443ca7972a4986b95cd0', 'request_id': 'req-944e91c3-e2cb-4007-919a-90a4f47f18f0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.896419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] The token cache is being invalidate because project d19edac120a0443ca7972a4986b95cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:48.896966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.897647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:48.899248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1096/2161] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:48 2022] DELETE /identity/v3/projects/d19edac120a0443ca7972a4986b95cd0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:48.903712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:48.905403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:48.918048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bdd7d-5e77-4b11-a57b-a614fa9a6131 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:48.972789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:48.973643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:48.973927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:48.974200 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] PATH_INFO: `/v3/users/e11bbf4a5a83452f8eed07743d4a1da4` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:48.975412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11bbf4a5a83452f8eed07743d4a1da4)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:48.977340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:49.160936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:49.162385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:49.180598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e91c3-e2cb-4007-919a-90a4f47f18f0 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:49.186626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:49.188192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:49.188680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:49.189148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] PATH_INFO: `/v3/users/af6c03a7e7af4591996f074f95a320ef` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:49.189560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11bbf4a5a83452f8eed07743d4a1da4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.191493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6c03a7e7af4591996f074f95a320ef)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:49.193660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:49.198870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11bbf4a5a83452f8eed07743d4a1da4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.276583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11bbf4a5a83452f8eed07743d4a1da4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.277938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11bbf4a5a83452f8eed07743d4a1da4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.278574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-dd83fa55-3f24-462c-9eac-9115c61a7b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11bbf4a5a83452f8eed07743d4a1da4'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.308862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1066/2162] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:48 2022] DELETE /identity/v3/users/e11bbf4a5a83452f8eed07743d4a1da4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:49.373769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6c03a7e7af4591996f074f95a320ef'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.380766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6c03a7e7af4591996f074f95a320ef'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.478681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6c03a7e7af4591996f074f95a320ef'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.479361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6c03a7e7af4591996f074f95a320ef'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.480158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6c03a7e7af4591996f074f95a320ef'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.499319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1097/2163] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:49 2022] DELETE /identity/v3/users/af6c03a7e7af4591996f074f95a320ef => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:49.503971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:49.504556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:49.504847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:49.522146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:49.523435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:49.585905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1067/2164] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:49.605227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:49.606987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:49.669558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9b9a-86ad-4e57-8cfd-7cc1f5f7a90a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:49.673268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:49.673983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:49.674834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:49.675114 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:49.684151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:49.685582 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1504e1-af01-40a7-9b08-18240a942a59 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:49.696425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1098/2165] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:49.777549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:49.779018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:49.803931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36116a6c-a9df-4875-82e5-f373d53fb9ec None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:49.809672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:49.810573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:49.810863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:49.811143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] PATH_INFO: `/v3/projects/a4ade873fa16474ca7a943822e66214a` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:49.812601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ade873fa16474ca7a943822e66214a)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:49.814507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:49.950593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ade873fa16474ca7a943822e66214a', 'request_id': 'req-d8ff6894-5585-47be-86a0-bf4970fd29b9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.957229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ade873fa16474ca7a943822e66214a', 'request_id': 'req-d8ff6894-5585-47be-86a0-bf4970fd29b9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:49.962474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ade873fa16474ca7a943822e66214a', 'request_id': 'req-d8ff6894-5585-47be-86a0-bf4970fd29b9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.076363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] The token cache is being invalidate because project a4ade873fa16474ca7a943822e66214a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:50.076728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.077611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d8ff6894-5585-47be-86a0-bf4970fd29b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.079377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1068/2166] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:49 2022] DELETE /identity/v3/projects/a4ade873fa16474ca7a943822e66214a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:50.084988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba107-808f-426b-8051-3820e0491dcb None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.085292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba107-808f-426b-8051-3820e0491dcb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.085558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacba107-808f-426b-8051-3820e0491dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.104414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-bacba107-808f-426b-8051-3820e0491dcb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:50.105661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-bacba107-808f-426b-8051-3820e0491dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.164562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1099/2167] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:50.172585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.172905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.173174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.192713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:50.194163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.195495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba107-808f-426b-8051-3820e0491dcb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.198166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-bacba107-808f-426b-8051-3820e0491dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.204598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1069/2168] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:50.219348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.219453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacba107-808f-426b-8051-3820e0491dcb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.228256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac120-018c-430a-b0ae-ad9864080d31 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.231375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.232197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.232489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.232770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] PATH_INFO: `/v3/projects/958639807d754449aced2da4c9e33baa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.233760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.234337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=958639807d754449aced2da4c9e33baa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.234444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.235225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.235559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.236284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.236499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:50.236965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.238674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.254518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1070/2169] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:50.255537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.266117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609d34d-d2a5-4995-ae2f-6e2aa7346c0c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.271933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.272695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.273011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.273285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.273968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.275922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.405306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958639807d754449aced2da4c9e33baa', 'request_id': 'req-85e36b0d-6eed-405d-ba15-734e33db4119'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.411503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958639807d754449aced2da4c9e33baa', 'request_id': 'req-85e36b0d-6eed-405d-ba15-734e33db4119'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.417022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958639807d754449aced2da4c9e33baa', 'request_id': 'req-85e36b0d-6eed-405d-ba15-734e33db4119'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.479342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1071/2170] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:50 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:50.480708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.537047 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] The token cache is being invalidate because project 958639807d754449aced2da4c9e33baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:50.537471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.539958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.539958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1100/2171] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:50 2022] DELETE /identity/v3/projects/958639807d754449aced2da4c9e33baa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:50.543400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6362f-cf2f-4c75-a713-8ffa90f82866 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.543662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.545447 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.548448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.549863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.550156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.550519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.551386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.553446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.613019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e36b0d-6eed-405d-ba15-734e33db4119 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.617845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.618713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.619000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.619278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] PATH_INFO: `/v3/users/f724f9bbbf6747ac8753420df87f7a3f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.620660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f724f9bbbf6747ac8753420df87f7a3f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.622686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.643075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1072/2172] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:50 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:50.650220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.654161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.666825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1668-f27a-43e4-a728-1412940f280d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.675702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.676551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.676901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.677355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.678068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.679768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.694153 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1073/2173] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:50.695147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.705241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed423095-974a-495f-af8e-897c896184ba admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.710706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.711375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.711662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.711939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.712657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.714320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.727486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1074/2174] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:50.729101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.739766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39dabb-b735-4f3c-993b-cb034f5a44db admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:50.744703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:50.745657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.745941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.746219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] PATH_INFO: `/v3/projects/260e21310ae841e58241553c88e18795/users/5bbf59c9cfa74b529796534e4b266eef/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.761102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=260e21310ae841e58241553c88e18795, user_id=5bbf59c9cfa74b529796534e4b266eef, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:50.763809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d657c-7f25-4696-8b59-254885b7fb8c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:50.819178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f724f9bbbf6747ac8753420df87f7a3f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.825991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f724f9bbbf6747ac8753420df87f7a3f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.836668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1075/2175] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:50 2022] PUT /identity/v3/projects/260e21310ae841e58241553c88e18795/users/5bbf59c9cfa74b529796534e4b266eef/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:50.841639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:50.841953 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:50.847245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:50.859210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:50.860469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.917761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1076/2176] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:50.921928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f724f9bbbf6747ac8753420df87f7a3f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.922587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f724f9bbbf6747ac8753420df87f7a3f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.923221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f724f9bbbf6747ac8753420df87f7a3f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:50.928008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:50.929371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:50.942050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1101/2177] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:50 2022] DELETE /identity/v3/users/f724f9bbbf6747ac8753420df87f7a3f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:50.991306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9208-c39b-4e0c-9c05-b02094974495 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:51.040407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:51.041061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:51.041345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:51.041619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:51.043563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.103931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:51.105379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:51.114805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1077/2178] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:51.451140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:51.454368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.467384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:51.469885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.471798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f50a-b240-4883-98b1-d665345dbca1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:51.494193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:51.495467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:51.495971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:51.496460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] PATH_INFO: `/v3/users/1ee8301a31934e378517fad4993407ae` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:51.497981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee8301a31934e378517fad4993407ae)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:51.501127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0e6f4-d358-41cf-ba3f-2015a3641ce8 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:51.501218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:51.519422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:51.520290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:51.523289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:51.523289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] PATH_INFO: `/v3/projects/011ced718d854ed0be70c4c4b440ad3b` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:51.523289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011ced718d854ed0be70c4c4b440ad3b)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:51.524250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:51.751276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011ced718d854ed0be70c4c4b440ad3b', 'request_id': 'req-d1e3f414-4811-4597-a603-ae6bfe118ee9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.760118 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011ced718d854ed0be70c4c4b440ad3b', 'request_id': 'req-d1e3f414-4811-4597-a603-ae6bfe118ee9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.763436 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee8301a31934e378517fad4993407ae'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.781084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee8301a31934e378517fad4993407ae'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.789453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011ced718d854ed0be70c4c4b440ad3b', 'request_id': 'req-d1e3f414-4811-4597-a603-ae6bfe118ee9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.848385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee8301a31934e378517fad4993407ae'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.849039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee8301a31934e378517fad4993407ae'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.851902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f093aee0-2192-445a-ada3-06e8d84ea833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee8301a31934e378517fad4993407ae'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.880019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1102/2179] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:51 2022] DELETE /identity/v3/users/1ee8301a31934e378517fad4993407ae => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:51.884409 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:51.884935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:51.885432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:51.906010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:51.907231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.950787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] The token cache is being invalidate because project 011ced718d854ed0be70c4c4b440ad3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:51.951078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.951856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d1e3f414-4811-4597-a603-ae6bfe118ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:51.953565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1078/2180] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:51 2022] DELETE /identity/v3/projects/011ced718d854ed0be70c4c4b440ad3b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:51.959174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9596-52e5-427b-97cc-0e19cf3bc5ea None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:51.959558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9596-52e5-427b-97cc-0e19cf3bc5ea None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:51.959905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f9596-52e5-427b-97cc-0e19cf3bc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:51.973464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1103/2181] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:51.979665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-026f9596-52e5-427b-97cc-0e19cf3bc5ea None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:51.981093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-026f9596-52e5-427b-97cc-0e19cf3bc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.990231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:51.990231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:51.990677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1079/2182] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:51.999496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.000541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.001112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.026564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:52.028170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:52.037665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1080/2183] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:52.041845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.046997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3da7b1-c0d1-439b-b94d-64893f0db4f0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.051098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9442195-5e6a-4f09-9dda-268b5a5ac046 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.051226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.051980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.052316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.052878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.056408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.057067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.057357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.057645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.058373 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:52.058687 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.060465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.063290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.064913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.073130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1081/2184] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:52.076923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1104/2185] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:52.077440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.087970 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf4ff4-b991-47d2-be30-6d89efddb81f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.092773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.093438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.093727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.094011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.094940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.097583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.261420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1082/2186] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:52 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:52.267189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.278524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594c00-0b5b-408e-8b08-b9ea4b3e69ed service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.349234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.350118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.350599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.351093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.352541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.355767 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.475415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1105/2187] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:52 2022] POST /identity/v3/users => generated 284 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:52.479502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.489848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b95f-0789-4d5c-90dc-5a86d51a0a41 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.494398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.495060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.495375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.495660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.496392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.498050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.513093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1083/2188] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:52.521252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.531925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dad51-b7c9-47f7-99e2-ba16513fdc6d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.536631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.537285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.537574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.537856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.538586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.540221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.551102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1106/2189] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:52.555858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.566782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1a516-86c3-4177-8f96-fb7868e2f6f3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.571614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.574593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.574593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.574593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] PATH_INFO: `/v3/projects/7ad23de3bfa14ef6b8959ca5d22234d3/users/b611fd5dc3af4b94bcc3292dfc65c9d3/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.579042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.581375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:52.594755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710d524-e6fb-4f4c-9060-4250cbc982e2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.598069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad23de3bfa14ef6b8959ca5d22234d3, user_id=b611fd5dc3af4b94bcc3292dfc65c9d3, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.600414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.600847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc7d04-89e2-4731-81d1-2250c5fd29d7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.601422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.601784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.602136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] PATH_INFO: `/v3/projects/bfa29bc358244c07976267e757365346` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.603462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa29bc358244c07976267e757365346)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.605570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.708235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1084/2190] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:52 2022] PUT /identity/v3/projects/7ad23de3bfa14ef6b8959ca5d22234d3/users/b611fd5dc3af4b94bcc3292dfc65c9d3/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:52.718358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.718649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.718927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.749629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] MFA Rules not processed for user `b611fd5dc3af4b94bcc3292dfc65c9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:52.750999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:52.752669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa29bc358244c07976267e757365346', 'request_id': 'req-767dd17b-1436-47c7-87a9-774e8dde6e4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:52.759567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa29bc358244c07976267e757365346', 'request_id': 'req-767dd17b-1436-47c7-87a9-774e8dde6e4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:52.765323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa29bc358244c07976267e757365346', 'request_id': 'req-767dd17b-1436-47c7-87a9-774e8dde6e4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:52.827355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] The token cache is being invalidate because project bfa29bc358244c07976267e757365346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:52.831721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:52.831721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:52.831991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1085/2191] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:52.832860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1107/2192] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:52 2022] DELETE /identity/v3/projects/bfa29bc358244c07976267e757365346 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:52.836725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.837485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:52.842203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:52.936890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16aa82-10c5-4845-a01d-01aff631668f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.937219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd17b-1436-47c7-87a9-774e8dde6e4f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:52.941115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.941973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.942481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.942801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:52.943100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.944199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.946163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:52.963703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:52.964248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:52.964543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] PATH_INFO: `/v3/users/133e7c42be8141d3bba3febef62667df` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:52.967501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133e7c42be8141d3bba3febef62667df)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:52.969698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.062538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1108/2193] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:52 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:53.063329 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.067467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:53.177629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620bd2b-1182-4b68-ac57-7f677fe08969 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.185085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.186813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.191211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.191211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] PATH_INFO: `/v3/users/14c0bb6188294bca88f5f0bcd8dc41af` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.191211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c0bb6188294bca88f5f0bcd8dc41af)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.193267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.198204 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133e7c42be8141d3bba3febef62667df'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.213462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133e7c42be8141d3bba3febef62667df'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.304989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133e7c42be8141d3bba3febef62667df'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.305694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133e7c42be8141d3bba3febef62667df'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.306368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133e7c42be8141d3bba3febef62667df'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.326951 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1086/2194] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:52 2022] DELETE /identity/v3/users/133e7c42be8141d3bba3febef62667df => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:53.328138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.331748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:53.423937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad97fb-a775-47b1-adf6-03be9451d656 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.425189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c0bb6188294bca88f5f0bcd8dc41af'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.430845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.430845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.431116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.431557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.434336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c0bb6188294bca88f5f0bcd8dc41af'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.440053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.442123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.507955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c0bb6188294bca88f5f0bcd8dc41af'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.512043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c0bb6188294bca88f5f0bcd8dc41af'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.513017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a6f67cd7-f71c-4ecb-9b59-5fed255b33fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c0bb6188294bca88f5f0bcd8dc41af'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:53.538941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1109/2195] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:38:53 2022] DELETE /identity/v3/users/14c0bb6188294bca88f5f0bcd8dc41af => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:53.544309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.544309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.544309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.559144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1087/2196] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:53 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:53.567838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.569701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:53.584395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:53.585634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:53.591009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9dfc-48da-4ee4-bf4e-1b42b05f7f0c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.654203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.655131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.655460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.655768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.656526 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.658169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.660870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1110/2197] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:53.669502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1088/2198] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:53.672565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.676701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.678939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:53.692252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ef5d2-ac83-4390-a80d-353e500e110c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.699905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.701643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.705723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.705723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] PATH_INFO: `/v3/projects/1b8b91ac435144f586aa29800a7f9d1c/users/050b884d91bd4a91adb71491ac7a2a1c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.724697 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8b91ac435144f586aa29800a7f9d1c, user_id=050b884d91bd4a91adb71491ac7a2a1c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.728810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.793469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95188d-1815-4b3f-9d84-c29f9d88167d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.799108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.799939 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.800501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.800875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.811652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.813653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.819076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1089/2199] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:53 2022] PUT /identity/v3/projects/1b8b91ac435144f586aa29800a7f9d1c/users/050b884d91bd4a91adb71491ac7a2a1c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:53.823378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:53.835736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1111/2200] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:53.945834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b99ad-6fd9-4ce8-90a5-be2b5fa17edc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:53.969383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:53.970821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:53.971484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:53.972473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:53.973069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:53.975926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793cc77-ac3b-438e-b5d8-bad94b4a9435 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:53.988558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1090/2201] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:54.001591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.022108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014cbc5-53c3-40c6-819e-c6699c76bc07 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.027167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.028105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.028394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.028670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] PATH_INFO: `/v3/projects/1b8b91ac435144f586aa29800a7f9d1c/users/050b884d91bd4a91adb71491ac7a2a1c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.033672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8b91ac435144f586aa29800a7f9d1c, user_id=050b884d91bd4a91adb71491ac7a2a1c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.039416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.052708 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1112/2202] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:53 2022] PUT /identity/v3/projects/1b8b91ac435144f586aa29800a7f9d1c/users/050b884d91bd4a91adb71491ac7a2a1c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:54.070355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.070657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.070952 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.132105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.135716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] MFA Rules not processed for user `050b884d91bd4a91adb71491ac7a2a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:54.136513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.137282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.241493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c530fa-3b60-473f-b878-b669290d1202 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.250728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1091/2203] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:54.251187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.251187 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.251535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.251819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] PATH_INFO: `/v3/projects/506d1180c5614dddb69893922698318e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.253992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] RBAC: Authorizing `identity:delete_project(project_id=506d1180c5614dddb69893922698318e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.257190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.260333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.261830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.405207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a155a-5ae8-4b40-8a04-602de6ea73ef None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.410196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.411276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.411781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.412263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.423956 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.426318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.444302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1092/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:54.490383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506d1180c5614dddb69893922698318e', 'request_id': 'req-b9c07e4c-0df0-4745-8b6f-56caeb07883b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:54.497563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506d1180c5614dddb69893922698318e', 'request_id': 'req-b9c07e4c-0df0-4745-8b6f-56caeb07883b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:54.516946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506d1180c5614dddb69893922698318e', 'request_id': 'req-b9c07e4c-0df0-4745-8b6f-56caeb07883b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:54.597149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.598602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.606711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] The token cache is being invalidate because project 506d1180c5614dddb69893922698318e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:54.606711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:54.606711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b9c07e4c-0df0-4745-8b6f-56caeb07883b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:54.608050 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1113/2205] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:54 2022] DELETE /identity/v3/projects/506d1180c5614dddb69893922698318e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:54.611275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9131-f85d-4a0d-92ad-9e2d576752c7 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.612493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7edae-7034-4384-af34-c124b16f0390 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.612894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7edae-7034-4384-af34-c124b16f0390 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.613280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7edae-7034-4384-af34-c124b16f0390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.656485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-9fa7edae-7034-4384-af34-c124b16f0390 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:54.658453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9fa7edae-7034-4384-af34-c124b16f0390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.743466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.747031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.748101 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.748560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.757155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.782335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1114/2206] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:54.784655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.784655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.784938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.818341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:54.819835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:54.834685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1115/2207] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:54.836628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.847834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024a0e0-0594-4f04-ba40-3f5c804d15c4 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.853867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.854561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.854847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.855423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.856260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:54.856575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.862344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.882442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1116/2208] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:38:54.887522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.904166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885d2b-5da1-4d1b-a145-890d43d2b448 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:54.910233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:54.910991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:54.911270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:54.911580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:54.915179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.915179 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.921495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:54.923557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:54.944350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1093/2209] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:54.996127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:54.996127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:55.025878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d803d5-e955-4182-be98-2b9f7d680d4c service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.032380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.033548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.035317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.035891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] PATH_INFO: `/v3/projects/bd60e65f7e2f47d88c32db7316df6f1f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.045395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd60e65f7e2f47d88c32db7316df6f1f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.049149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.084341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1117/2210] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:54 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:55.089984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.187279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd60e65f7e2f47d88c32db7316df6f1f', 'request_id': 'req-7ea050c1-1f50-4310-b7a1-3ad8a4452735'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:55.199056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd60e65f7e2f47d88c32db7316df6f1f', 'request_id': 'req-7ea050c1-1f50-4310-b7a1-3ad8a4452735'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:55.218582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd60e65f7e2f47d88c32db7316df6f1f', 'request_id': 'req-7ea050c1-1f50-4310-b7a1-3ad8a4452735'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:55.237070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77576698-d546-4265-8747-cf4b7f888e21 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.325790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.326491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.327005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.327319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.328034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.329981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.344884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] The token cache is being invalidate because project bd60e65f7e2f47d88c32db7316df6f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:38:55.345469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:55.346071 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7ea050c1-1f50-4310-b7a1-3ad8a4452735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:38:55.350113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1094/2211] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:38:54 2022] DELETE /identity/v3/projects/bd60e65f7e2f47d88c32db7316df6f1f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:55.352557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6df4-94d4-4950-afb2-c2259d091dc9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.352924 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6df4-94d4-4950-afb2-c2259d091dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.353284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6df4-94d4-4950-afb2-c2259d091dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.390867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-20ae6df4-94d4-4950-afb2-c2259d091dc9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:55.392267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-20ae6df4-94d4-4950-afb2-c2259d091dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:55.402950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1095/2212] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:55.416851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.416851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.417674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.438478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:55.440347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:55.446449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1118/2213] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/users => generated 284 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:55.449596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1096/2214] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:55.450570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.453257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.456509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:55.462949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7936e-bd4d-42c2-95fd-fa8f59d5f2a4 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.469014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353698b9-8683-4fb3-88e9-23f5b7e99410 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.469191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.469702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.470065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.470269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.471313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:38:55.471730 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.473464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.474131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.474988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.475286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.475596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.476339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.478005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.487530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1097/2215] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:38:55.491129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1119/2216] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:55.499882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.503726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.523858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2a325-d1f0-4b7f-a120-8e3399d1cb27 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.530592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef987043-c4b9-4ce8-8e87-e8b26c8dbf61 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.531063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.532051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.532351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.532631 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.533366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.535699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.537641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.542530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.542530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.542530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.542530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.542530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.554498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1120/2217] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:55.559025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.575599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe31b4-55e0-4fb5-ab73-df4a276953e4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.584457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.585795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.586080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.586364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] PATH_INFO: `/v3/projects/f887fa543f534e04a28d083f78b9449c/users/a6d39c38a15742e394f7c88cab325d26/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.607052 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f887fa543f534e04a28d083f78b9449c, user_id=a6d39c38a15742e394f7c88cab325d26, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.610405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305ff8-de8b-4a9b-adb2-971e71111e48 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.639348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1098/2218] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:55.643923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.721982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5bea3-977b-4de9-9c41-802450cab984 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.729846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:55.730638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.730993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.731380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.732230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:55.734383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:55.746110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1121/2219] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:55 2022] PUT /identity/v3/projects/f887fa543f534e04a28d083f78b9449c/users/a6d39c38a15742e394f7c88cab325d26/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:55.756986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:55.757209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:55.757496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:55.794728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] MFA Rules not processed for user `a6d39c38a15742e394f7c88cab325d26`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:55.796264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:55.823128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1099/2220] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:55.833077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:55.854182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae154d5-ce47-4187-87fd-ad6e126a91a6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:55.907848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1122/2221] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:55.912023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.017489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533cf71-acfd-4d9a-a36a-4cffebcccacc None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.038696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.040344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.043149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.043149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.043149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.043964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.043964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.044141 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.044514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.047825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.052714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.056004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.088562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1100/2222] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:56.094535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.116580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83246-4e90-4b2a-a469-1cdd7442ea07 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.124018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.125095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.125394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.125680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.126424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.128818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.141969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1101/2223] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:56.147030 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.173297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e119d9-ecee-4079-9f82-0031e4e1bea0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.190828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1123/2224] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:55 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:56.193821 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.214511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.218692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.222834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.224651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] PATH_INFO: `/v3/projects/7cb904c57a7d4d3fbb9171d542fb780b/users/c75702fe320343f8bbcf0d6810036b2c/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.275913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb904c57a7d4d3fbb9171d542fb780b, user_id=c75702fe320343f8bbcf0d6810036b2c, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.282893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15506daa-762c-46cd-ad07-6e0531caee26 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.365220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0841-c09b-4f9a-bb8c-dfe21e56019a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.369935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1102/2225] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:56 2022] PUT /identity/v3/projects/7cb904c57a7d4d3fbb9171d542fb780b/users/c75702fe320343f8bbcf0d6810036b2c/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:56.389182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.389473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.389778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.453587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] MFA Rules not processed for user `c75702fe320343f8bbcf0d6810036b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:56.454890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:56.512661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.513954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.514431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.514931 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.516061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.519653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.594678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1103/2226] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:56.596232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.607795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1124/2227] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:56 2022] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:56.610230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1efe1e-b3e9-41b7-919b-9ad709ea4530 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.612783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.617642 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.620340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.620739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.621596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.622870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.626274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.640603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bdf43-aaad-4105-ada7-275bc832edbf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.649090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.650145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.650565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.650859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.651955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.654336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.666433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1125/2228] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:56.670531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.684209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52e163-84de-4e5e-900d-9940aae03d4d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.689023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.690491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.690781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.691060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] PATH_INFO: `/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae/users/80a00b8392ef4979a7a62b675ec113e0/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.711779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ccf66b9a8643fdbe8b5ac383b382ae, user_id=80a00b8392ef4979a7a62b675ec113e0, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.714871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.741530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1104/2229] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:56 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:56.745531 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.788355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1126/2230] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:56 2022] PUT /identity/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae/users/80a00b8392ef4979a7a62b675ec113e0/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:56.792599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:56.848053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ba6db-48f7-4cb9-a743-e15d2eef5c80 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.942844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c699-6c68-4efd-8034-784b40bbe74a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:56.958406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.959782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.960438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.960878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.961198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:56.961999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:56.962314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.962433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:56.962792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:56.963640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:56.965468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.965918 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:56.986384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1127/2231] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:38:56.988558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.003205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541aac7-3cb6-4b8b-8831-6a9b676aeab3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:57.009269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:57.010158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.010451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.010727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] PATH_INFO: `/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae/users/80a00b8392ef4979a7a62b675ec113e0/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.013218 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ccf66b9a8643fdbe8b5ac383b382ae, user_id=80a00b8392ef4979a7a62b675ec113e0, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:57.016086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e4657-00cb-4501-a0c3-3a971b60f24e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:57.032603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1128/2232] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:56 2022] PUT /identity/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae/users/80a00b8392ef4979a7a62b675ec113e0/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:57.043270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.043525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.043804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.076192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1105/2233] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:56 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:57.081527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.091288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] MFA Rules not processed for user `80a00b8392ef4979a7a62b675ec113e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:57.092629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:57.102283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81479b-1e0d-4301-8d92-97aafee3c6a7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:57.209148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:57.209657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.209944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.210219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.211056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:57.216921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:57.246435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1106/2234] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:57.250900 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.259201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1129/2235] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:57.270238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2e63-fafa-4456-a9a5-fc39434b2091 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:57.271362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.276600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:57.291817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:57.293592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.293809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.294093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.297198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:57.301380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:57.331848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1107/2236] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:57.337873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.365180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fec673-2d1b-4b12-b0df-b241901f2efa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:57.374314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:57.375216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.375532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.375809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] PATH_INFO: `/v3/projects/ccbc35f88d3c45beacea2c5e772378dd/users/564ca9ce5fa44a1e81a7f71ef6ae66f5/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.406551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b018a8-e06a-4bf1-b258-a508dec76c4c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:57.413977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbc35f88d3c45beacea2c5e772378dd, user_id=564ca9ce5fa44a1e81a7f71ef6ae66f5, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:57.416085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:57.416759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.416888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:57.417057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.417327 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.435513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:57.437066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8c207-f42f-4081-9309-d955e37502c5 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:57.448915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1130/2237] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:38:57.681692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1108/2238] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:57 2022] PUT /identity/v3/projects/ccbc35f88d3c45beacea2c5e772378dd/users/564ca9ce5fa44a1e81a7f71ef6ae66f5/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:57.694669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:57.694971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:57.695280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:57.760972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] MFA Rules not processed for user `564ca9ce5fa44a1e81a7f71ef6ae66f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:57.764748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:57.863216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.946957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1131/2239] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:38:57.948787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:57.997716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9a34-7c1e-4ced-9e43-44129c59ede0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.016034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.016034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.016034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.016034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.164528 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376eb4-9c75-47ce-bda9-19f6fc8896be None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.178266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.179031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.179355 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.179698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.180465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.183766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.206421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.206421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.228080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1109/2240] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:58.318983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1132/2241] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:57 2022] POST /identity/v3/projects => generated 383 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:58.321386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:58.335969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bd30-e17f-47eb-a2a6-6d9a6c001e4f service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.437116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.437823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.438103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.438905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.439240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.442652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.574290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1110/2242] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:58 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:58.578129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:58.589384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3298d3-f3b0-48f9-a649-bd24bc8a7638 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.594852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.595516 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.595829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.596108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.596851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.598498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.614497 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1133/2243] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:58.616554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:58.638029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d33897-aee7-40f1-a6ee-11865f26557c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.643501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.644408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.644694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.644968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] PATH_INFO: `/v3/projects/de0dec8f55f941bf816d7839663dca87/users/307b0e7fbd864c2086685de5f1d02c79/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.663151 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0dec8f55f941bf816d7839663dca87, user_id=307b0e7fbd864c2086685de5f1d02c79, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.663417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.768280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1111/2244] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:58 2022] PUT /identity/v3/projects/de0dec8f55f941bf816d7839663dca87/users/307b0e7fbd864c2086685de5f1d02c79/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:38:58.773608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:58.799458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1375-7124-4b99-951b-f7d502dd19f9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.919800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.920510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.920805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.921091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.921846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.923519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1123fb-c354-4639-9c9b-31204855a29b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.953410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:58.955545 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1134/2245] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:58.969436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a0b4-e570-4af3-89da-447fef433992 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:58.972390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:58.973553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:58.973989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:58.974440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] PATH_INFO: `/v3/projects/de0dec8f55f941bf816d7839663dca87/users/307b0e7fbd864c2086685de5f1d02c79/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:58.976836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0dec8f55f941bf816d7839663dca87, user_id=307b0e7fbd864c2086685de5f1d02c79, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:58.980627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:58.993384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1112/2246] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:58 2022] PUT /identity/v3/projects/de0dec8f55f941bf816d7839663dca87/users/307b0e7fbd864c2086685de5f1d02c79/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:38:59.004353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225dd0-6e7a-48e8-8666-6d2d02da362e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.004782 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225dd0-6e7a-48e8-8666-6d2d02da362e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.005249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225dd0-6e7a-48e8-8666-6d2d02da362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.045553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-87225dd0-6e7a-48e8-8666-6d2d02da362e None None] MFA Rules not processed for user `307b0e7fbd864c2086685de5f1d02c79`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:59.051919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-87225dd0-6e7a-48e8-8666-6d2d02da362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:59.179737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1135/2247] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:59.197399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:59.199242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:59.291237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.291660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.291976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.312464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d4604-bc1a-400b-9474-a61b18052712 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:59.316988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:59.317686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.318041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.318319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.357726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] MFA Rules not processed for user `5bbf59c9cfa74b529796534e4b266eef`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:38:59.357726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:59.398427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:59.400179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:59.411796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1113/2248] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:38:59.476736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1136/2249] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:38:59.481176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:59.482794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:38:59.566845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53bb5d-37ec-4088-aefc-67eec9ddb5d5 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:59.572995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:59.573767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.574055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.574321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.575161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:59.577317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:59.699885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1114/2250] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:38:59 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:38:59.702588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:59.714684 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ac3d-fb6b-4d4c-ad75-b6e1f726893f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:59.779654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:59.785942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.785942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.785942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.785942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:59.785942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:59.879475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1137/2251] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:38:59 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:38:59.883418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:59.896950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3074-643a-4f6c-bab7-b90be7b8fa7b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:59.901943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:59.902633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.902923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.903207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.911890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:59.913668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:38:59.932406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1115/2252] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:38:59.946640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:38:59.958396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8db9-6939-4675-ab69-de5cb4da33a4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:38:59.967023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:38:59.972505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:38:59.972833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:38:59.973181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] PATH_INFO: `/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea/users/ed04ae53959b4dfe9cbee253a115e4a1/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:38:59.994424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f29f947ae24ac897d2b7c23824c2ea, user_id=ed04ae53959b4dfe9cbee253a115e4a1, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:38:59.995832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:00.123358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1138/2253] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:38:59 2022] PUT /identity/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea/users/ed04ae53959b4dfe9cbee253a115e4a1/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:00.124411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:00.140292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197711-8c0d-4182-ad01-a0665ac10944 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:00.243742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:00.244543 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:00.244830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:00.247527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:00.257849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:00.257849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:00.270248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1116/2254] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:00.273318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:00.286830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71664cc-d38d-41ce-b179-e727a7b1f7b6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:00.305498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:00.312178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:00.312178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:00.315510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] PATH_INFO: `/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea/users/ed04ae53959b4dfe9cbee253a115e4a1/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:00.319131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f29f947ae24ac897d2b7c23824c2ea, user_id=ed04ae53959b4dfe9cbee253a115e4a1, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:00.322830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:00.343645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1139/2255] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:00 2022] PUT /identity/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea/users/ed04ae53959b4dfe9cbee253a115e4a1/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:01.621036 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:01.622871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:01.655651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b698-1ddb-4342-b011-85c258e9fa08 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:01.742566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:01.756680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:01.758908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:01.759374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:01.759858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] PATH_INFO: `/v3/users/b611fd5dc3af4b94bcc3292dfc65c9d3` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:01.761439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b611fd5dc3af4b94bcc3292dfc65c9d3)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:01.763837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:01.891451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46c89-805b-41a4-89c2-e8eede930633 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:01.897377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:01.898321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:01.898764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:01.899205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:01.999255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b611fd5dc3af4b94bcc3292dfc65c9d3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:02.013794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:02.016564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cc8a5-9ee5-4349-a564-82304e9e134b service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:02.017212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b611fd5dc3af4b94bcc3292dfc65c9d3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:02.036913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1140/2256] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:02.106552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b611fd5dc3af4b94bcc3292dfc65c9d3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:02.106552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b611fd5dc3af4b94bcc3292dfc65c9d3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:02.109197 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b611fd5dc3af4b94bcc3292dfc65c9d3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:02.183606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1117/2257] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:01 2022] DELETE /identity/v3/users/b611fd5dc3af4b94bcc3292dfc65c9d3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:02.185637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:02.185637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:02.185925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:02.232601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:02.235172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:02.355955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1141/2258] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:02.368386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:02.375675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:02.442824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9f84a-01cb-4b12-b72d-d3dd9cec12fa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:02.447359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:02.447577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:02.447943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:02.448318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:02.460420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:02.464727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:02.478397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1118/2259] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:03.018547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:03.020863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:03.052855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f271bc-91bd-4c30-8fd3-0f8a1f107c65 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:03.062530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:03.063449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:03.063934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:03.065043 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] PATH_INFO: `/v3/projects/7ad23de3bfa14ef6b8959ca5d22234d3` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:03.066564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad23de3bfa14ef6b8959ca5d22234d3)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:03.069478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:03.297225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad23de3bfa14ef6b8959ca5d22234d3', 'request_id': 'req-c9a841d4-63ec-4dd0-9a23-65b4419839e5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.308380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad23de3bfa14ef6b8959ca5d22234d3', 'request_id': 'req-c9a841d4-63ec-4dd0-9a23-65b4419839e5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.316067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad23de3bfa14ef6b8959ca5d22234d3', 'request_id': 'req-c9a841d4-63ec-4dd0-9a23-65b4419839e5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.453820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] The token cache is being invalidate because project 7ad23de3bfa14ef6b8959ca5d22234d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:03.454350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.456522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.464226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1142/2260] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:03 2022] DELETE /identity/v3/projects/7ad23de3bfa14ef6b8959ca5d22234d3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:03.464906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:03.480098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf95c-857a-4de7-9af4-010ec03138ba service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:03.643958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:03.645342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:03.645637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:03.645923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] PATH_INFO: `/v3/users/050b884d91bd4a91adb71491ac7a2a1c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:03.659988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=050b884d91bd4a91adb71491ac7a2a1c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:03.659988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:03.970181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050b884d91bd4a91adb71491ac7a2a1c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:03.989186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050b884d91bd4a91adb71491ac7a2a1c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:04.103796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050b884d91bd4a91adb71491ac7a2a1c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:04.104426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050b884d91bd4a91adb71491ac7a2a1c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:04.105037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050b884d91bd4a91adb71491ac7a2a1c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:04.173391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1119/2261] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:03 2022] DELETE /identity/v3/users/050b884d91bd4a91adb71491ac7a2a1c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:04.343026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:04.345248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:04.463353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a841d4-63ec-4dd0-9a23-65b4419839e5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:04.567534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:04.569339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:04.570373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:04.570839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:04.575944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:04.693265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:04.701745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414e4a2-ca05-4675-8690-059c71967e14 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:04.724023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1143/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:05.393624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:05.399610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:05.498691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d8e4d-3c22-447a-ae65-e7e488796faa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:05.506649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:05.507688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:05.508106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:05.508381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] PATH_INFO: `/v3/projects/1b8b91ac435144f586aa29800a7f9d1c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:05.510583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8b91ac435144f586aa29800a7f9d1c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:05.517788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:05.655962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8b91ac435144f586aa29800a7f9d1c', 'request_id': 'req-17cff978-9d12-49bb-a8ec-e8478ca5a858'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:05.670658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8b91ac435144f586aa29800a7f9d1c', 'request_id': 'req-17cff978-9d12-49bb-a8ec-e8478ca5a858'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:05.680716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8b91ac435144f586aa29800a7f9d1c', 'request_id': 'req-17cff978-9d12-49bb-a8ec-e8478ca5a858'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:05.761540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] The token cache is being invalidate because project 1b8b91ac435144f586aa29800a7f9d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:05.765538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:05.766923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-17cff978-9d12-49bb-a8ec-e8478ca5a858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:05.772632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1120/2263] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:05 2022] DELETE /identity/v3/projects/1b8b91ac435144f586aa29800a7f9d1c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:05.777461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:05.777833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:05.780315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:05.807848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:05.809112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:05.875857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1144/2264] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:05.885841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:05.886240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:05.886742 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:05.930417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:05.933500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:05.948926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1121/2265] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:05.952453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:05.969353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545198-0925-4c63-abdd-74c6d9742059 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:05.976923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:05.977909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:05.978189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:05.981944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:05.981944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:05.981944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:05.983278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.002321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1145/2266] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:39:06.007644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.018870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5939-5052-4b76-b989-cba844ee982b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.038680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.039438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.039729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.040005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.048032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.052616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.192739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1122/2267] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:06.196667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.226189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad657-eeed-42d1-bee1-09d1d5bcd705 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.340140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.340834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.341120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.341398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.343220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.348624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.488963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1146/2268] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:06 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:06.491698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.518622 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5223a-4f95-44ac-a287-516465cf4ce0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.532139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.532139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.532139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.532139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.532424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.535377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.558441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1123/2269] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:06.559440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.580310 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f76375-70e7-4391-9464-75805f296aa9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.587033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.587792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.588262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.592903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.593861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.596468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3215b2-f57c-4897-ba8c-e70a16c339df admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.610291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1147/2270] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:39:06.612582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.623129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab294ca-0c37-4922-95bf-b2b749dcce9f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.628017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.629395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.629395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.629395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] PATH_INFO: `/v3/projects/bec73279a32046b7b73fe40dc85e8828/users/8b76d8a965e94428938f497bafc7dba5/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.644892 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec73279a32046b7b73fe40dc85e8828, user_id=8b76d8a965e94428938f497bafc7dba5, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.647575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.742357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1124/2271] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:06 2022] PUT /identity/v3/projects/bec73279a32046b7b73fe40dc85e8828/users/8b76d8a965e94428938f497bafc7dba5/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:06.753054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.753351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.753635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.781811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] MFA Rules not processed for user `8b76d8a965e94428938f497bafc7dba5`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:06.783658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:06.804998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.808409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:06.926318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1148/2272] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:06.932854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:06.965136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb4723-6e98-4b74-8c7e-593b8c0a5b00 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.965696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968984e-8e71-4f36-839c-cfd7dcc7bfd5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:06.973281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.975281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.975812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.976243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:06.976726 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] PATH_INFO: `/v3/users/a6d39c38a15742e394f7c88cab325d26` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.976906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:06.978261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:06.983381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:06.983495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d39c38a15742e394f7c88cab325d26)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.983604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:06.983987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:06.991065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.144112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1149/2273] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:07.148351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.233099 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d39c38a15742e394f7c88cab325d26'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:07.241939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d39c38a15742e394f7c88cab325d26'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:07.256128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3df035-ef32-4a90-b3e6-aedc97fcc37a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.261728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.262504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.262794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.263128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.264064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.267048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.357789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d39c38a15742e394f7c88cab325d26'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:07.358440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d39c38a15742e394f7c88cab325d26'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:07.359207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-36f62171-d615-4be9-8083-64bec254efa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d39c38a15742e394f7c88cab325d26'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:07.385139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1125/2274] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:06 2022] DELETE /identity/v3/users/a6d39c38a15742e394f7c88cab325d26 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:07.390736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.391169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.391482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.396549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1150/2275] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:07 2022] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:07.397851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.399883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:07.415475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:07.416678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:07.418824 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fbf5f-be2d-4547-9cd5-f148a74b2b71 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.500070 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.508127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.508127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.508127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.508127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.510113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.522446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1151/2276] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:07.525183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1126/2277] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:07.526635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.540415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.557342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:07.560077 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9529540-a6f9-4e6d-bb4b-81cd31fffe22 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.580792 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.581720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.582352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.582352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] PATH_INFO: `/v3/projects/00b4798718ce455ebb019b9125a2fd6b/users/25934373fa3e480d9c0e6a92bbb6b57e/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.603993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b4798718ce455ebb019b9125a2fd6b, user_id=25934373fa3e480d9c0e6a92bbb6b57e, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.607344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.655669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9c365-a769-4c6d-9d57-96503549fab6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.659927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.660959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.661252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.661536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.672252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.673837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.690597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1127/2278] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:07.723590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1152/2279] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:07 2022] PUT /identity/v3/projects/00b4798718ce455ebb019b9125a2fd6b/users/25934373fa3e480d9c0e6a92bbb6b57e/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:07.727460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.739161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ea2f2-b9cb-4160-a1ef-5e72e0c441a0 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.818645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.819455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.819752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.820029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.820827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.822797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28f245-5724-49a9-899f-d115568c77fd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.835739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1128/2280] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:07.838234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:07.849651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dfc9-9664-4443-810d-fdb263a78fdf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:07.855783 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:07.857827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.858263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.858763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] PATH_INFO: `/v3/projects/00b4798718ce455ebb019b9125a2fd6b/users/25934373fa3e480d9c0e6a92bbb6b57e/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.863451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b4798718ce455ebb019b9125a2fd6b, user_id=25934373fa3e480d9c0e6a92bbb6b57e, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:07.866415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:07.889330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1153/2281] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:07 2022] PUT /identity/v3/projects/00b4798718ce455ebb019b9125a2fd6b/users/25934373fa3e480d9c0e6a92bbb6b57e/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:07.890658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:07.890964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:07.891247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:07.934905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] MFA Rules not processed for user `25934373fa3e480d9c0e6a92bbb6b57e`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:07.945590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:08.144796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1129/2282] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:08.160672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:08.162853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:08.267165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c726f49-9c39-4468-a53b-d505339cc9a9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:08.277319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:08.280253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:08.283190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:08.283625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:08.333594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:08.336902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:08.363954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1154/2283] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:08.380090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:08.381772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:08.531523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c17505-1402-4f94-b827-fa84cc489e7b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:08.558247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:08.559160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:08.559538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:08.559825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] PATH_INFO: `/v3/projects/f887fa543f534e04a28d083f78b9449c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:08.564181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f887fa543f534e04a28d083f78b9449c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:08.578849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:08.628683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:08.641652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b2d0-13f8-4bfd-890d-c6c38b6669ad service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:08.650725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:08.651538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:08.651829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:08.652111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:08.667434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:08.774451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:08.780739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f887fa543f534e04a28d083f78b9449c', 'request_id': 'req-07d1af8b-a7c4-4748-bd2c-77e96b26f808'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:08.781268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1bc7-9400-452c-af4b-b0863cf29edb service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:08.792629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f887fa543f534e04a28d083f78b9449c', 'request_id': 'req-07d1af8b-a7c4-4748-bd2c-77e96b26f808'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:08.797803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1155/2284] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:08.805202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f887fa543f534e04a28d083f78b9449c', 'request_id': 'req-07d1af8b-a7c4-4748-bd2c-77e96b26f808'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:08.924002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] The token cache is being invalidate because project f887fa543f534e04a28d083f78b9449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:08.924329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:08.925187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:08.927628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1130/2285] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:08 2022] DELETE /identity/v3/projects/f887fa543f534e04a28d083f78b9449c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:08.931223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:08.931870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:08.933010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:08.933127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:08.933870 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.011328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] MFA Rules not processed for user `ed04ae53959b4dfe9cbee253a115e4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:09.013270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.049078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1af8b-a7c4-4748-bd2c-77e96b26f808 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:09.055245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:09.056303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:09.056689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:09.057190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] PATH_INFO: `/v3/users/80a00b8392ef4979a7a62b675ec113e0` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.059059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a00b8392ef4979a7a62b675ec113e0)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:09.065049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:09.125304 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1156/2286] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:09.139010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:09.146687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.251795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a084e97-d07e-4cbe-9f04-e09bb9d68b5d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:09.257164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:09.258901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:09.259315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:09.259786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.262830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.332712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:09.334440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:09.351650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1157/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:09.361785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a00b8392ef4979a7a62b675ec113e0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.371205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a00b8392ef4979a7a62b675ec113e0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.394291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:09.396303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.414471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f90d56-77fa-4682-b80b-92011f032c1b service glance] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:09.419687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:09.420567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:09.420853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:09.421129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] PATH_INFO: `/v3/users/8b76d8a965e94428938f497bafc7dba5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.422332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b76d8a965e94428938f497bafc7dba5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:09.425004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:09.525585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a00b8392ef4979a7a62b675ec113e0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.526613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a00b8392ef4979a7a62b675ec113e0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.527413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-625c9a95-02d8-4388-8085-2a50ad4cb031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a00b8392ef4979a7a62b675ec113e0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.552508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1131/2288] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:08 2022] DELETE /identity/v3/users/80a00b8392ef4979a7a62b675ec113e0 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:09.709508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b76d8a965e94428938f497bafc7dba5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.741525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b76d8a965e94428938f497bafc7dba5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.767613 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:09.768169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:09.768775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.836604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:09.842262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.864519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b76d8a965e94428938f497bafc7dba5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.865413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b76d8a965e94428938f497bafc7dba5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.866666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a032673f-f27f-4f8c-b68b-c27b849dad9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b76d8a965e94428938f497bafc7dba5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:09.903023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1158/2289] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:09 2022] DELETE /identity/v3/users/8b76d8a965e94428938f497bafc7dba5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:09.904815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:09.905382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:09.905860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:09.943946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:09.950131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:09.996562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1132/2290] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:10.109667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1159/2291] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:10.113440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:10.115746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.116472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:10.117864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.224820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752fe7a-9ea9-4e45-bf4a-26a1ec428e85 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:10.231958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547900-e5b5-4b97-8116-e3a9926966dd None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:10.247702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:10.247702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.247702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.247702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.280718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:10.280718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:10.302813 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1160/2292] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:10.303844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:10.309335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.353629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f89f88-776b-4236-8236-ebe839120b28 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:10.369181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:10.370199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.370617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.370989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] PATH_INFO: `/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.372536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ccf66b9a8643fdbe8b5ac383b382ae)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:10.374540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:10.461128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:10.464382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.468395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.468395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.602661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:10.605116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:10.609241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ccf66b9a8643fdbe8b5ac383b382ae', 'request_id': 'req-0c147693-acf1-4b9b-aff0-b347e8a8cf88'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.616756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ccf66b9a8643fdbe8b5ac383b382ae', 'request_id': 'req-0c147693-acf1-4b9b-aff0-b347e8a8cf88'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.618058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1133/2293] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:39:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:39:10.618995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:10.620736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.622315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ccf66b9a8643fdbe8b5ac383b382ae', 'request_id': 'req-0c147693-acf1-4b9b-aff0-b347e8a8cf88'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.641336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e68ac-c48f-4ebd-87ed-ecb2be0bac1c service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:10.720091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:10.721270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.721704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] The token cache is being invalidate because project c1ccf66b9a8643fdbe8b5ac383b382ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:10.721847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.725162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.725288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] PATH_INFO: `/v3/users/c75702fe320343f8bbcf0d6810036b2c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.725369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c147693-acf1-4b9b-aff0-b347e8a8cf88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.725461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75702fe320343f8bbcf0d6810036b2c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:10.725554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1161/2294] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:10 2022] DELETE /identity/v3/projects/c1ccf66b9a8643fdbe8b5ac383b382ae => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:10.726911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:10.729553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f72e3-aad2-4d38-8b99-b8fede847662 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.730056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f72e3-aad2-4d38-8b99-b8fede847662 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.730324 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f72e3-aad2-4d38-8b99-b8fede847662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.800484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2c2f72e3-aad2-4d38-8b99-b8fede847662 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:10.802382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2c2f72e3-aad2-4d38-8b99-b8fede847662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.824433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1162/2295] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:10.836997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.837463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.838378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.870580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:10.872044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:10.889647 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1163/2296] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:10.894217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:10.909080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ecc7f-fe46-4f76-9c56-47d30ea42230 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:10.915375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:10.916058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:10.927772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:10.927772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:10.927772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:10.927772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:10.950540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:10.953946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75702fe320343f8bbcf0d6810036b2c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.974508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75702fe320343f8bbcf0d6810036b2c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:10.981383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1164/2297] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:39:10.992272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.007862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e9e4d-c095-4859-95ff-c727a800668b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:11.014508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:11.015672 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:11.016200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:11.016664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:11.018468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:11.021105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:11.098494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75702fe320343f8bbcf0d6810036b2c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.106646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75702fe320343f8bbcf0d6810036b2c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.107606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75702fe320343f8bbcf0d6810036b2c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.158113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1165/2298] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:10 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:11.158113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.161605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:11.179222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1134/2299] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:10 2022] DELETE /identity/v3/users/c75702fe320343f8bbcf0d6810036b2c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:11.183897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.189706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:11.332445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac5dd9-5a7a-45c4-aaea-2831ab67f9b2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:11.344061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:11.344886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:11.345243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:11.347114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:11.349146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:11.353085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770a4d4-89e2-4ffa-a61b-22c624a96575 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:11.353814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56db4b-68a1-454b-95d7-96963b5ca7b9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:11.365573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:11.366561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:11.367265 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:11.368985 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] PATH_INFO: `/v3/projects/bec73279a32046b7b73fe40dc85e8828` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:11.370325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec73279a32046b7b73fe40dc85e8828)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:11.372636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:11.513464 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1135/2300] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:11 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:11.514731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:11.515062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:11.515633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:11.686404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:11.686404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:11.686404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1136/2301] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:11.686404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.686404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d6d42-598a-4795-9aef-ffbe7c1dafc1 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:11.688570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:11.688570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:11.688570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:11.688570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:11.689067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:11.689067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:11.689067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1137/2302] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:11.689067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.689067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:11.689528 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec73279a32046b7b73fe40dc85e8828', 'request_id': 'req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.702953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec73279a32046b7b73fe40dc85e8828', 'request_id': 'req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.718664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec73279a32046b7b73fe40dc85e8828', 'request_id': 'req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.851205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ceb6-ffbb-4d68-9a42-3c24ef244120 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:11.890331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] The token cache is being invalidate because project bec73279a32046b7b73fe40dc85e8828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:11.890648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.891340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:11.897206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1166/2303] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:11 2022] DELETE /identity/v3/projects/bec73279a32046b7b73fe40dc85e8828 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:11.897206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:11.907384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.000326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:12.005896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.005896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.005896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.007516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.132096 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc0010-126d-4b41-8ec0-6296ef2e01dd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:12.144358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:12.151901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.151901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.151901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.151901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:12.158248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:12.179920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:12.181658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bebb0-874c-4ace-8666-536d0a7465e0 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:12.190162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1167/2304] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:12.190162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:12.195422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.215538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1138/2305] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:12.217958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.221077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.221717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.264780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b8b3-61b1-4d48-b1ad-95cde9d32836 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:12.276051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:12.277076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.277364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.277644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] PATH_INFO: `/v3/users/25934373fa3e480d9c0e6a92bbb6b57e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.279227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25934373fa3e480d9c0e6a92bbb6b57e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:12.285245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:12.307414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:12.309565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.473944 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1139/2306] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:12.475894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:12.505743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86865e6-4f7b-4b08-9103-3d65ca99206a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:12.515084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:12.516673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.517773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.518562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] PATH_INFO: `/v3/projects/9600bca2e3c44bdab083e3ef536d41fa/users/792e3af6788d4a8d9a36cf367d07091a/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.539444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25934373fa3e480d9c0e6a92bbb6b57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:12.546342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9600bca2e3c44bdab083e3ef536d41fa, user_id=792e3af6788d4a8d9a36cf367d07091a, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:12.550894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:12.571016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25934373fa3e480d9c0e6a92bbb6b57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:12.651422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25934373fa3e480d9c0e6a92bbb6b57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:12.652054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25934373fa3e480d9c0e6a92bbb6b57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:12.652681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e04a9ff9-f629-4c94-bcbc-c345a53b9184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25934373fa3e480d9c0e6a92bbb6b57e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:12.667594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1140/2307] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:12 2022] PUT /identity/v3/projects/9600bca2e3c44bdab083e3ef536d41fa/users/792e3af6788d4a8d9a36cf367d07091a/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:12.668723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:12.671826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.695336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1168/2308] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:12 2022] DELETE /identity/v3/users/25934373fa3e480d9c0e6a92bbb6b57e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:12.695336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.695336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.695336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.781245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] MFA Rules not processed for user `792e3af6788d4a8d9a36cf367d07091a`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:12.784713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.804141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e5e73-d00c-423a-9ebb-54a48cb68331 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:12.872105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1169/2309] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:12.884513 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:12.894758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:12.943096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:12.946327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:12.946863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:12.947340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:12.952026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:13.007046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e7381-9568-4dd4-8da1-46ac2b97b141 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:13.014774 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:13.016040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:13.022402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:13.022402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:13.031386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:13.034461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:13.045700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1170/2310] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:13.046889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:13.051198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:13.114167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:13.121335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:13.126370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b756da-3a5b-4ffc-90c1-d49f4b23b299 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:13.131362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:13.132233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:13.132776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:13.132776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] PATH_INFO: `/v3/projects/7cb904c57a7d4d3fbb9171d542fb780b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:13.133998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb904c57a7d4d3fbb9171d542fb780b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:13.136016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:13.142723 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1141/2311] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:39:13.319164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb904c57a7d4d3fbb9171d542fb780b', 'request_id': 'req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:13.338693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb904c57a7d4d3fbb9171d542fb780b', 'request_id': 'req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:13.347344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb904c57a7d4d3fbb9171d542fb780b', 'request_id': 'req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:13.426790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] The token cache is being invalidate because project 7cb904c57a7d4d3fbb9171d542fb780b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:13.427181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:13.428575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:13.435093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:13.435590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1171/2312] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:13 2022] DELETE /identity/v3/projects/7cb904c57a7d4d3fbb9171d542fb780b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:13.457342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec66b2-b30e-49b2-8174-33114202697f service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:13.727641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:13.728834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:13.729328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:13.729761 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] PATH_INFO: `/v3/users/564ca9ce5fa44a1e81a7f71ef6ae66f5` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:13.731413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564ca9ce5fa44a1e81a7f71ef6ae66f5)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:13.745678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:13.815223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:13.815223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:13.845571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147de847-8fe4-48a1-a5c4-fd51a9dc0e18 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:13.896146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:13.897033 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:13.897316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:13.897594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] PATH_INFO: `/v3/projects/00b4798718ce455ebb019b9125a2fd6b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:13.901872 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b4798718ce455ebb019b9125a2fd6b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:13.925282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:14.194873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b4798718ce455ebb019b9125a2fd6b', 'request_id': 'req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.198440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564ca9ce5fa44a1e81a7f71ef6ae66f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.212407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564ca9ce5fa44a1e81a7f71ef6ae66f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.224726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b4798718ce455ebb019b9125a2fd6b', 'request_id': 'req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.254163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b4798718ce455ebb019b9125a2fd6b', 'request_id': 'req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.330594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564ca9ce5fa44a1e81a7f71ef6ae66f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.331316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564ca9ce5fa44a1e81a7f71ef6ae66f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.331961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5a8fe0d9-6fe6-4776-9c42-e207c2cdeab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564ca9ce5fa44a1e81a7f71ef6ae66f5'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.383034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1142/2313] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:13 2022] DELETE /identity/v3/users/564ca9ce5fa44a1e81a7f71ef6ae66f5 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:14.428648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] The token cache is being invalidate because project 00b4798718ce455ebb019b9125a2fd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:14.429353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.430363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1e7b25ab-5c72-4d37-b694-ea7e67d1bd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:14.432286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1172/2314] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:13 2022] DELETE /identity/v3/projects/00b4798718ce455ebb019b9125a2fd6b => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:14.437676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:14.437975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:14.438304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:14.506114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:14.516774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:14.756339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1143/2315] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:14.768765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:14.769325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:14.769773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:14.796486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:14.798810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:14.818087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1173/2316] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:14.822020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:14.841048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775bfc-2113-4ea2-8cd6-32089d653d7a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:14.859546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:14.859546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:14.859546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:14.859546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:14.860050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:14.860050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:14.861569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:14.914058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1144/2317] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:39:14.918742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:14.929104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394265f-c617-403f-875f-92b4a8f38b2b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:14.950814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:14.956934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:14.956934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:14.956934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:14.956934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:14.956934 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:15.129099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1174/2318] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:15.133402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.149864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c8ea1-b76b-48d5-a3c0-1627bc3438d1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:15.312871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.312871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:15.326715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:15.330316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:15.330316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:15.330316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:15.330316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:15.331135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:15.338089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef9f08-56b7-4085-828c-ea3a89de4d7c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:15.347268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:15.348186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:15.348474 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:15.348793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] PATH_INFO: `/v3/projects/ccbc35f88d3c45beacea2c5e772378dd` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:15.351169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbc35f88d3c45beacea2c5e772378dd)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:15.353128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:15.458419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1145/2319] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:15 2022] POST /identity/v3/users => generated 288 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:15.461139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.498111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5a415-6544-45f5-84d9-0b608cc4d0bb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:15.537753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:15.541806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:15.542688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:15.543671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:15.545122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:15.553109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:15.557174 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbc35f88d3c45beacea2c5e772378dd', 'request_id': 'req-404ec52a-2006-42d6-8873-13e88f981b65'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:15.574766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbc35f88d3c45beacea2c5e772378dd', 'request_id': 'req-404ec52a-2006-42d6-8873-13e88f981b65'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:15.586554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1146/2320] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:39:15.587809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.630093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbc35f88d3c45beacea2c5e772378dd', 'request_id': 'req-404ec52a-2006-42d6-8873-13e88f981b65'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:15.661256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868f6a9-0b03-4dc7-9df7-a78c05959f16 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:15.758948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] The token cache is being invalidate because project ccbc35f88d3c45beacea2c5e772378dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:15.759164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:15.761054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:15.765360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1175/2321] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:15 2022] DELETE /identity/v3/projects/ccbc35f88d3c45beacea2c5e772378dd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:15.769129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.771607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:15.888067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:15.888678 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:15.888969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:15.889248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:15.889983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:15.907063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:15.944358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1147/2322] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:15.945274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:15.952001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:15.982348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e5cfa-ef69-4dbc-a0ef-9f0e8d83e39f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:15.993266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:15.994472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:15.994964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:15.995488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] PATH_INFO: `/v3/projects/8282009afb72407f95c12fd499928364/users/8ec597e22797438e86740641dbdfb636/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:15.995634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ec52a-2006-42d6-8873-13e88f981b65 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:16.003417 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:16.011547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:16.011547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:16.011547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] PATH_INFO: `/v3/users/307b0e7fbd864c2086685de5f1d02c79` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:16.011547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307b0e7fbd864c2086685de5f1d02c79)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:16.013439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:16.045537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8282009afb72407f95c12fd499928364, user_id=8ec597e22797438e86740641dbdfb636, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:16.051961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e587019-a163-43b4-9e13-0c9409bada73 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:16.149816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1148/2323] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:15 2022] PUT /identity/v3/projects/8282009afb72407f95c12fd499928364/users/8ec597e22797438e86740641dbdfb636/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:16.162365 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:16.162840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:16.163476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:16.277076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307b0e7fbd864c2086685de5f1d02c79'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:16.288583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] MFA Rules not processed for user `8ec597e22797438e86740641dbdfb636`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:16.289579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307b0e7fbd864c2086685de5f1d02c79'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:16.289835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:16.421627 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307b0e7fbd864c2086685de5f1d02c79'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:16.422438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307b0e7fbd864c2086685de5f1d02c79'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:16.423106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307b0e7fbd864c2086685de5f1d02c79'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:16.438620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1149/2324] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:16.462885 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1176/2325] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:15 2022] DELETE /identity/v3/users/307b0e7fbd864c2086685de5f1d02c79 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:16.879422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:16.880957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:17.026967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d1b3c-3862-4df0-a9aa-9a04585efea0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:17.100161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:17.101558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:17.101846 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:17.102123 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] PATH_INFO: `/v3/users/4d37e209401e499dab95751d095239cf` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:17.103563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d37e209401e499dab95751d095239cf)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:17.105516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:17.349736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:17.351227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:17.369115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8132bd-b6c1-4e53-9526-b90dc425fdd1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:17.376410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:17.377843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:17.378132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:17.378418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] PATH_INFO: `/v3/projects/de0dec8f55f941bf816d7839663dca87` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:17.380314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0dec8f55f941bf816d7839663dca87)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:17.382223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:17.566998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0dec8f55f941bf816d7839663dca87', 'request_id': 'req-cc45dca9-2612-471c-af3a-e7eb4eb9516c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.576006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0dec8f55f941bf816d7839663dca87', 'request_id': 'req-cc45dca9-2612-471c-af3a-e7eb4eb9516c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.584367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0dec8f55f941bf816d7839663dca87', 'request_id': 'req-cc45dca9-2612-471c-af3a-e7eb4eb9516c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.588718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d37e209401e499dab95751d095239cf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.607217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d37e209401e499dab95751d095239cf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.661710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] The token cache is being invalidate because project de0dec8f55f941bf816d7839663dca87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:17.662590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.664030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-cc45dca9-2612-471c-af3a-e7eb4eb9516c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.670248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1177/2326] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:17 2022] DELETE /identity/v3/projects/de0dec8f55f941bf816d7839663dca87 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:17.675520 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6948b-3e90-42dd-87cc-955153f087fd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:17.676051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6948b-3e90-42dd-87cc-955153f087fd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:17.676537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6948b-3e90-42dd-87cc-955153f087fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:17.703379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7be6948b-3e90-42dd-87cc-955153f087fd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:17.705695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7be6948b-3e90-42dd-87cc-955153f087fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:17.735117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d37e209401e499dab95751d095239cf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.736108 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d37e209401e499dab95751d095239cf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.737095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-af536700-2217-4b5a-9408-e3c75c567b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d37e209401e499dab95751d095239cf'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:17.785772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1150/2327] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:16 2022] DELETE /identity/v3/users/4d37e209401e499dab95751d095239cf => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:17.792300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:17.792821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:17.793321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:17.826120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:17.827792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:17.835226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1178/2328] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:17.844490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:17.844840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:17.845132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:17.881873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:17.883139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:17.988681 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1151/2329] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:17.999449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.001259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:18.014868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1179/2330] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:18.019437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.035081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731eb7b-3459-4ace-85e3-b705ae7e7b22 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.039954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.040626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.040909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.041185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.041913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:18.042219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.043833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:18.061562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1180/2331] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:39:18.062463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.079653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927102d-fcea-4a95-8bd6-8ffcec82806f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.085416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.086086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.086374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.086661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.087374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.089272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:18.148721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50cd3f-f472-455f-b717-e9bcf58896ba None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.181381 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.182212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.183508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.184262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.214189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1181/2332] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:18.219341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.221701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:18.225557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.260147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1152/2333] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:18.390734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b030b6a-465f-4a2e-89d8-bde1c4ed0fab admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.422612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.424245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.424780 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.425769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.426744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.429127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:18.941175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1182/2334] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:18 2022] POST /identity/v3/users => generated 286 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:39:18.942075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.953116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea2ca6-a045-4b98-8bb0-fc82494fa5ad service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.959374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.962650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.962650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.962650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.962650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.963616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:18.975337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1153/2335] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:18.978295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:18.990690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b478fa-a5e8-4409-b1bd-8e8333082c45 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:18.995896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:18.997136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:18.997136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:18.997136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:18.997805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:18.999498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bac29-fb09-45b8-829d-71e39db40ff1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:19.015422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:19.026205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1183/2336] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:19.031544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e15d9-4517-4356-bbf0-1d9eb1e33260 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:19.035168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:19.036304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.036782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.037146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] PATH_INFO: `/v3/projects/56157eb1b34a49cb9c1880aa943b7837/users/6b7043ef79844c799d1c4707114ee73c/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.054709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56157eb1b34a49cb9c1880aa943b7837, user_id=6b7043ef79844c799d1c4707114ee73c, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:19.057514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:19.140916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1154/2337] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:19 2022] PUT /identity/v3/projects/56157eb1b34a49cb9c1880aa943b7837/users/6b7043ef79844c799d1c4707114ee73c/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:19.155814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.156102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.156383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.204738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] MFA Rules not processed for user `6b7043ef79844c799d1c4707114ee73c`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:19.206500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:19.301671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:19.303393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:19.304977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1184/2338] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:19.321295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:19.322747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:19.403339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb00b25-0c90-4a5a-99fc-5e7130809835 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:19.409595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:19.410538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.410891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.411330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] PATH_INFO: `/v3/projects/91ac37267ed64621b5b16935cd73755a` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.412629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ac37267ed64621b5b16935cd73755a)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:19.415596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:19.490340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5030b5-db31-42c3-86c9-7b03c6062d7d None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:19.524401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:19.525498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.525981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.526459 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.552688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:19.554453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:19.555517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ac37267ed64621b5b16935cd73755a', 'request_id': 'req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:19.564801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ac37267ed64621b5b16935cd73755a', 'request_id': 'req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:19.577120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ac37267ed64621b5b16935cd73755a', 'request_id': 'req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:19.601825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1185/2339] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:19.643752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:19.669145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00097-61b1-49c5-a7cf-91687c5df702 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:19.678411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] The token cache is being invalidate because project 91ac37267ed64621b5b16935cd73755a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:19.679562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:19.681819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-51b23d49-c07e-44ae-97f3-ed4ef48d5b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:19.690161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1155/2340] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:19 2022] DELETE /identity/v3/projects/91ac37267ed64621b5b16935cd73755a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:19.697263 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385090-6ad2-4fc5-81c3-0ff800f747bf None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.697552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385090-6ad2-4fc5-81c3-0ff800f747bf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.697877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385090-6ad2-4fc5-81c3-0ff800f747bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.766231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-60385090-6ad2-4fc5-81c3-0ff800f747bf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:19.767547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-60385090-6ad2-4fc5-81c3-0ff800f747bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:19.836695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:19.837800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:19.838190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:19.838606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] PATH_INFO: `/v3/users/6b7043ef79844c799d1c4707114ee73c` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:19.842012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7043ef79844c799d1c4707114ee73c)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:19.843401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.010810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1156/2341] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:20.012519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.012821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.013102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.044301 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:20.045597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:20.068692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1157/2342] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:20.072508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.090144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519c33b-e0df-438b-b141-b26f0154dc85 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.094380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7043ef79844c799d1c4707114ee73c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:20.103099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7043ef79844c799d1c4707114ee73c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:20.126781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.127719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.132843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.133322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.134910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:20.140748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.140748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.156384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1158/2343] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:39:20.167364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.181536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7043ef79844c799d1c4707114ee73c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:20.182466 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7043ef79844c799d1c4707114ee73c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:20.183352 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-877b9f62-ada8-4e13-9e3a-851f7f4de7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7043ef79844c799d1c4707114ee73c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:20.188177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57559-39ba-41ef-a3b0-d199efd5c0d3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.203904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.209936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1186/2344] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:19 2022] DELETE /identity/v3/users/6b7043ef79844c799d1c4707114ee73c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:20.215016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.215521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.216030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.221159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.221455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.223455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.224338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.226288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.238215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:20.240550 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:20.331072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1187/2345] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:20.338450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1159/2346] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:20 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:39:20.338981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.340620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:20.341692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.343499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:20.367049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eec63-260d-490e-a9a9-0094eb2fe5f7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.444241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695dad-fae2-48b8-a7c5-e6c809bb859d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.461249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.461932 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.465017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.465017 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.531725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.536765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.537102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.537395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.538529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.541617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.646572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1188/2347] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:20 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:39:20.650629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.679247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.686565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87f6e-9348-4d5b-9930-a956705e1bd1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.691706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.702213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.702910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.703206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.703518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.704260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.709280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.730361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1189/2348] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:20.731111 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1160/2349] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:20.734145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.754677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8248319-1206-44cf-9a71-f906c1c03e76 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.769048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.770937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.771450 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.771742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.772500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.777249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280f618-7f3d-4ef5-81e2-1cc520536681 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:20.823628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1190/2350] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:20.825982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:20.849928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466f92-64d4-443b-acae-f8856b7fb6a3 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:20.863315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:20.865690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:20.866047 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:20.866475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] PATH_INFO: `/v3/projects/c1bcb57c2e244aceb2ca6d49b3276d7e/users/1c577c166b4b4419be1494e34800a710/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:20.919594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1bcb57c2e244aceb2ca6d49b3276d7e, user_id=1c577c166b4b4419be1494e34800a710, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:20.923443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:21.052552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1161/2351] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:20 2022] PUT /identity/v3/projects/c1bcb57c2e244aceb2ca6d49b3276d7e/users/1c577c166b4b4419be1494e34800a710/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:21.060068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:21.061165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:21.061165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:21.100799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:21.101868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:21.345128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1191/2352] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:21.364754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:21.499847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5e46-04d0-4d83-b644-bc718159f6fb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:21.506004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:21.506004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:21.506004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:21.506004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:21.518333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:21.519905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093ff92-33e6-4cdd-b60d-a08c9ba2f09f service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:21.544386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1162/2353] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:21.580628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:21.584397 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:21.625426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f11ff-a0f2-41c7-98cb-0ae68bc670f9 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:21.633995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:21.635338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:21.637927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:21.637927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] PATH_INFO: `/v3/projects/56157eb1b34a49cb9c1880aa943b7837` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:21.639650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56157eb1b34a49cb9c1880aa943b7837)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:21.641982 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:22.112617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56157eb1b34a49cb9c1880aa943b7837', 'request_id': 'req-d05ef706-e71d-4de8-aef3-9283892d321c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:22.131080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56157eb1b34a49cb9c1880aa943b7837', 'request_id': 'req-d05ef706-e71d-4de8-aef3-9283892d321c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:22.146573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56157eb1b34a49cb9c1880aa943b7837', 'request_id': 'req-d05ef706-e71d-4de8-aef3-9283892d321c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:22.666464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] The token cache is being invalidate because project 56157eb1b34a49cb9c1880aa943b7837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:22.666878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:22.667632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d05ef706-e71d-4de8-aef3-9283892d321c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:22.695234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1192/2354] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:21 2022] DELETE /identity/v3/projects/56157eb1b34a49cb9c1880aa943b7837 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:22.699826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:22.700371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:22.700641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:22.725319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:22.726922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:22.829998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1163/2355] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:22.842080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:22.844239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:22.844239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:22.867897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:22.869553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:22.890242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:22.890958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1193/2356] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:22.905991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea2d9-4992-45ff-be5e-5cdf0f4a69fe None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:22.921385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:22.922079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:22.922366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:22.922641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:22.929508 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:22.930046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:22.931843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:22.956370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1164/2357] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:39:22.960841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:22.984079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5bab-0fb4-4063-b480-1f5e211e1391 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:23.000269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:23.001198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:23.002309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:23.002778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:23.003703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:23.007846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:23.131584 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1194/2358] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:22 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:23.135460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:23.154590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cb1cf-c066-44c4-80c4-265bf375d10d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:23.348573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:23.349425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:23.349972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:23.350348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:23.352656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:23.356246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:23.588633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:23.594324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1165/2359] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:23 2022] POST /identity/v3/users => generated 288 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:23.605986 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822fd74-145f-4f13-b31e-e103c1858b75 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:23.632073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:23.632772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:23.633161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:23.633336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:23.634069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:23.643950 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:23.684468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1195/2360] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:39:23.688802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:23.710935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22678123-2b35-47d0-9806-84880d59f4c6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:23.726199 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:23.733611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:23.733963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:23.734256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:23.735061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:23.738641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d091c2-c6d3-40d5-a4a0-9eb513fa0c60 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:23.764060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1166/2361] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:23.768641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:23.794471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bca282-0377-4b45-8cbc-18099a484ad6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:23.808844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:23.810131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:23.810590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:23.811054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] PATH_INFO: `/v3/projects/5fe5bd19f913484c8a91d07243db2dee/users/b4086aa939fb4870b24557f130f054be/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:23.878358 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe5bd19f913484c8a91d07243db2dee, user_id=b4086aa939fb4870b24557f130f054be, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:23.886802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:23.999830 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1196/2362] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:23 2022] PUT /identity/v3/projects/5fe5bd19f913484c8a91d07243db2dee/users/b4086aa939fb4870b24557f130f054be/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:24.021034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c582-1f3f-4333-8025-142395aea785 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:24.021384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c582-1f3f-4333-8025-142395aea785 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:24.021716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c582-1f3f-4333-8025-142395aea785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:24.067926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6555c582-1f3f-4333-8025-142395aea785 None None] MFA Rules not processed for user `b4086aa939fb4870b24557f130f054be`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:24.069554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6555c582-1f3f-4333-8025-142395aea785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:24.164004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1167/2363] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:24.165058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:24.166794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:24.248406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71833-44a4-45a6-9c76-1d24d180b398 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:24.252928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:24.253771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:24.254333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:24.254829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:24.267500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:24.269283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:24.278871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1197/2364] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:26.286264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4684c-7a10-4f1a-9ba5-2321e0fed360 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:26.286737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4684c-7a10-4f1a-9ba5-2321e0fed360 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:26.286842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4684c-7a10-4f1a-9ba5-2321e0fed360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:26.331066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-97c4684c-7a10-4f1a-9ba5-2321e0fed360 None None] MFA Rules not processed for user `b4086aa939fb4870b24557f130f054be`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:26.337626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:26.339668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:26.341449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-97c4684c-7a10-4f1a-9ba5-2321e0fed360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:26.366156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1168/2365] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:26.574493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7c485-30bd-49ed-9913-06ad2c9200c8 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:26.585253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:26.586249 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:26.586656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:26.587171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] PATH_INFO: `/v3/users/792e3af6788d4a8d9a36cf367d07091a` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:26.588534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792e3af6788d4a8d9a36cf367d07091a)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:26.590551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:26.848472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792e3af6788d4a8d9a36cf367d07091a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:26.868185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792e3af6788d4a8d9a36cf367d07091a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:26.974679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792e3af6788d4a8d9a36cf367d07091a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:26.975372 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792e3af6788d4a8d9a36cf367d07091a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:26.976068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792e3af6788d4a8d9a36cf367d07091a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:27.018859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1198/2366] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:26 2022] DELETE /identity/v3/users/792e3af6788d4a8d9a36cf367d07091a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:27.020380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:27.020672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:27.021131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:27.073385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:27.081090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:27.370882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1169/2367] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:27.393700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:27.395906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:27.599107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2946570-c53e-42e9-a55e-b7704166b007 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:27.604277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:27.605154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:27.605564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:27.606095 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:27.619025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:27.621815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eec80-8637-4e70-9c65-11c92660e1aa service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:27.651501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1199/2368] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:29.315686 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:29.319117 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:29.344128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129639b3-3254-4c87-900a-c0236702ba0e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:29.352502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:29.353822 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:29.354319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:29.354845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] PATH_INFO: `/v3/projects/9600bca2e3c44bdab083e3ef536d41fa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:29.356772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9600bca2e3c44bdab083e3ef536d41fa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:29.366142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:29.533568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9600bca2e3c44bdab083e3ef536d41fa', 'request_id': 'req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:29.541233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9600bca2e3c44bdab083e3ef536d41fa', 'request_id': 'req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:29.555045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9600bca2e3c44bdab083e3ef536d41fa', 'request_id': 'req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:30.037404 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] The token cache is being invalidate because project 9600bca2e3c44bdab083e3ef536d41fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:30.043664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:30.043664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:30.043664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1170/2369] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:29 2022] DELETE /identity/v3/projects/9600bca2e3c44bdab083e3ef536d41fa => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:30.045890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2e45-b80a-4d6b-ad07-e04f81465a05 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.046421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2e45-b80a-4d6b-ad07-e04f81465a05 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.046574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2e45-b80a-4d6b-ad07-e04f81465a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.065177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-992f2e45-b80a-4d6b-ad07-e04f81465a05 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:30.066431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-992f2e45-b80a-4d6b-ad07-e04f81465a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:30.112658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.113996 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:30.157505 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1200/2370] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:30.165186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.165388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.165819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.210607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:30.212808 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:30.243825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1201/2371] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:30.248162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.264464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c8394-fe5a-4b6e-9dfb-d347177027bf None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:30.270425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:30.276338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:30.287646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1202/2372] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:39:30.296025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.309204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ca4c7-ce87-4ae4-9bdf-9a2ae388b0a2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:30.310048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a94ab-b4c5-4b87-97e2-d07cba9b5506 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:30.315530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:30.315838 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:30.316510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.316955 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.317257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.318217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.318348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:30.318826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.320224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:30.320395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.323008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:30.427173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:30.428938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:30.440632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1171/2373] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:30.460480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1203/2374] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:30 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:30.464393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.501805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90489ba-8ecf-4611-8691-8fb52f4c60da service glance] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:30.685668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:30.693314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.693669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.693959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.694713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:30.699335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:30.868566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1172/2375] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:30 2022] POST /identity/v3/users => generated 285 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:30.869938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.884116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da7abb-fdce-4001-a734-89ac2262f8ca admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:30.898711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:30.901728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:30.902240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:30.902704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:30.906951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:30.909920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5047d5-969c-4ca3-986a-c0f219b12b75 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:30.957058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1204/2376] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:30.961433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:30.979569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeab342-4113-47fc-98b8-ef2b43cb8b99 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:31.006492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:31.007851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:31.012548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:31.013804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:31.015880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:31.018855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:31.052124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:31.052695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:31.052978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:31.085711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1173/2377] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:31.101868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:31.119132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] MFA Rules not processed for user `5bbf59c9cfa74b529796534e4b266eef`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:31.120440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:31.143188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f992-9db9-444f-845e-160f99d8f6ed admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:31.151852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:31.153329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:31.155901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:31.156592 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] PATH_INFO: `/v3/projects/b00bbb59b46e4938b28f27c7579fb6c2/users/6c8284a6d8404a34bf1957d366ba8456/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:31.177522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00bbb59b46e4938b28f27c7579fb6c2, user_id=6c8284a6d8404a34bf1957d366ba8456, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:31.181187 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231aae0-cf76-47f4-a724-3b2539f784ba admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:31.263736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1174/2378] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:31 2022] PUT /identity/v3/projects/b00bbb59b46e4938b28f27c7579fb6c2/users/6c8284a6d8404a34bf1957d366ba8456/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:31.279696 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60e36-3f00-4913-bb46-48283b1bad0b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:31.280584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60e36-3f00-4913-bb46-48283b1bad0b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:31.295329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60e36-3f00-4913-bb46-48283b1bad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:31.368493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1205/2379] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:31.377868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b0e60e36-3f00-4913-bb46-48283b1bad0b None None] MFA Rules not processed for user `6c8284a6d8404a34bf1957d366ba8456`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:31.381054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b0e60e36-3f00-4913-bb46-48283b1bad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:31.527182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1175/2380] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:31.536041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:31.691750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8dd16-7d19-43b7-9457-5f838ff6a6fb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:31.816069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:31.816746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:31.817032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:31.817389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:31.840484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:31.842195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:31.862675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1206/2381] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:32.325938 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:32.326358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:32.326772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:32.369988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] MFA Rules not processed for user `1c577c166b4b4419be1494e34800a710`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:32.376791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:32.550980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1176/2382] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:32.554221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:32.555903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:32.684796 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a204da-b4e9-400f-a25c-fcbe1db4e936 service glance] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:32.691694 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:32.693136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:32.693823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:32.694335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:32.695700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:32.697933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:32.824177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1207/2383] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:32 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:32.828926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:32.849855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2bcff-d30e-4d84-a0dd-c68412a5632a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:32.941334 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:32.942258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:32.943173 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:32.943823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:32.945195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:32.948904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:33.170617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1177/2384] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:32 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:33.174126 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:33.203903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada988e-3c35-4912-ba8c-17c16bc4f2da admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:33.246621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:33.247448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:33.247748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:33.248040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:33.248991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:33.250702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:33.307086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1208/2385] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:33.311170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:33.341792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b415-75e1-4f1d-883d-c583dda2370e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:33.341792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:33.343022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:33.343329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:33.343626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] PATH_INFO: `/v3/projects/a609c79e763d4c52a143bee7d875d8bc/users/12e5e9c2bb4242d29b3037253c2e942c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:33.372489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a609c79e763d4c52a143bee7d875d8bc, user_id=12e5e9c2bb4242d29b3037253c2e942c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:33.380269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:33.494062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1178/2386] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:33 2022] PUT /identity/v3/projects/a609c79e763d4c52a143bee7d875d8bc/users/12e5e9c2bb4242d29b3037253c2e942c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:33.508086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:33.535034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61460ef9-13d5-46d1-9245-0ca561543a97 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:33.611804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:33.612597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:33.612984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:33.613322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:33.614144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:33.615864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be986825-fdd6-450b-a2cc-12945c63c98e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:33.628021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1209/2387] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:33.631910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:33.644916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a55b-2644-43ab-b5d4-ee276a0fc972 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:33.649912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:33.650891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:33.651456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:33.652069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] PATH_INFO: `/v3/projects/a609c79e763d4c52a143bee7d875d8bc/users/12e5e9c2bb4242d29b3037253c2e942c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:33.654649 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a609c79e763d4c52a143bee7d875d8bc, user_id=12e5e9c2bb4242d29b3037253c2e942c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:33.682295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a0212-e85e-4a82-9bdd-6fe3cc203310 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:33.700038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1179/2388] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:33 2022] PUT /identity/v3/projects/a609c79e763d4c52a143bee7d875d8bc/users/12e5e9c2bb4242d29b3037253c2e942c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:40.503100 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315ccb-8650-4b75-9994-9721cdb0941a None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:40.504048 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315ccb-8650-4b75-9994-9721cdb0941a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:40.504553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315ccb-8650-4b75-9994-9721cdb0941a None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:40.507182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1210/2389] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:39:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:39:40.517016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:40.518098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:40.519105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:40.634357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:40.639453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:40.796824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1180/2390] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:42.235049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00993-0fcc-448d-b112-c072b35e431a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:42.236576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00993-0fcc-448d-b112-c072b35e431a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:42.237019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a00993-0fcc-448d-b112-c072b35e431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:42.293209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-35a00993-0fcc-448d-b112-c072b35e431a None None] MFA Rules not processed for user `12e5e9c2bb4242d29b3037253c2e942c`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:42.294724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-35a00993-0fcc-448d-b112-c072b35e431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:42.433764 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1211/2391] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:42.903221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:42.906329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:42.919861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c93e0a-d4f8-4268-b317-ac60aaffd5ff None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:42.926757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:42.927736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:42.928145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:42.928557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:42.991986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:42.993713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:43.005193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1181/2392] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:46.766115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646a3e-48e2-449f-9693-3010e490cede None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:46.766978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646a3e-48e2-449f-9693-3010e490cede None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:46.767444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646a3e-48e2-449f-9693-3010e490cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:46.812660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-70646a3e-48e2-449f-9693-3010e490cede None None] MFA Rules not processed for user `1c577c166b4b4419be1494e34800a710`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:46.814654 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-70646a3e-48e2-449f-9693-3010e490cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:46.830771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1212/2393] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:47.830427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:47.832585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:47.926243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005bc1-d82b-4693-b62e-398c5e8da3ee service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:47.930602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:47.931635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:47.933608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:47.933608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:47.943788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:47.945229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387df6f-31c8-4157-8fa6-0917ee2f2fd5 service glance] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:47.957487 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1182/2394] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:48.200598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5dc1-b721-4643-9ea9-0b7e5147dce3 None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.201131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5dc1-b721-4643-9ea9-0b7e5147dce3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.201231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5dc1-b721-4643-9ea9-0b7e5147dce3 None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.203089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1213/2395] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:39:48.213395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.213695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.213975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.235761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.235761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.235761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.248362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:48.249595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:48.306021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:48.307369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:48.334368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1214/2396] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:48.389147 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:48.390952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:48.399612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1183/2397] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:48.412066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6651a6-0b7c-4d04-9ebe-6f316d71802b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:48.416035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:48.416730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.416995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.417254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.421049 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:48.423265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:48.427108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:48.429760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9af34-c006-4c99-a36f-8a29c69072f8 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:48.441299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1215/2398] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:39:48.560702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a959a-88c4-4be7-a638-8ee2a8bec3b9 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:48.567546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:48.568218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.568496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.568771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.582335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3f2e-621d-4d35-ada1-e5c3ce4fab5b None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.582335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3f2e-621d-4d35-ada1-e5c3ce4fab5b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.582533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3f2e-621d-4d35-ada1-e5c3ce4fab5b None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.586771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1216/2399] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:39:48.591656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.591787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.592275 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.596994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:48.598732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:48.609401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1184/2400] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:39:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:39:48.616958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:48.618339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:48.633444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1217/2401] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:39:48.653219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:48.658148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4077eb-22b4-4cc2-b073-695794aa0b09 service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:48.662950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:48.666927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:48.666927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:48.666927 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:48.678717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:48.680458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:48.695980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1185/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:52.327658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:52.330475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:52.456220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d69a-7f42-4558-96ac-235f6a028b83 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:52.462377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:52.463620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:52.464071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:52.464429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] PATH_INFO: `/v3/users/0d6e4afb1882454c9ddedc3b14cf9cb1` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:52.466223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6e4afb1882454c9ddedc3b14cf9cb1)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:52.469330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:52.694049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6e4afb1882454c9ddedc3b14cf9cb1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:52.708854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6e4afb1882454c9ddedc3b14cf9cb1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:52.781411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6e4afb1882454c9ddedc3b14cf9cb1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:52.788387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6e4afb1882454c9ddedc3b14cf9cb1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:52.801924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e9a323d2-bc28-4978-9295-a5ffc21b6576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6e4afb1882454c9ddedc3b14cf9cb1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:52.811097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1218/2403] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:39:52 2022] DELETE /identity/v3/users/0d6e4afb1882454c9ddedc3b14cf9cb1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:53.080664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:53.098657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71b11d-dbcc-4aa9-ab80-0d54526f28ce service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:53.197128 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:53.197972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.198262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.198545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] PATH_INFO: `/v3/projects/6f97ed27bfc74d37afabc0df792afc42` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.199807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f97ed27bfc74d37afabc0df792afc42)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:53.201724 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:53.361239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f97ed27bfc74d37afabc0df792afc42', 'request_id': 'req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:53.362324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f97ed27bfc74d37afabc0df792afc42', 'request_id': 'req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:53.368600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f97ed27bfc74d37afabc0df792afc42', 'request_id': 'req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:53.448066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] The token cache is being invalidate because project 6f97ed27bfc74d37afabc0df792afc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:39:53.448283 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:53.448907 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c0bfb7cf-6a6e-49db-a396-8d9915b9a2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:39:53.450555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1186/2404] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:39:53 2022] DELETE /identity/v3/projects/6f97ed27bfc74d37afabc0df792afc42 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:39:53.456144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.456710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.456710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.491337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:53.493642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:53.598810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1219/2405] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:53.607343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.607644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.607929 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.643498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:53.644916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:53.659608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1187/2406] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:53.661585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:53.671518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c068d3-a323-4e8b-a9cb-ad840660e963 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:53.676919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:53.678053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.678825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.679220 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.679999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:39:53.680423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:53.682440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:53.698375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1220/2407] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:39:53.699563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:53.710190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee069-e86b-4578-8cbc-8f6cb7c826d3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:53.715351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:53.716195 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.716478 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.716753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.717456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:53.720429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:53.821802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1188/2408] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:39:53 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:53.826754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:53.844566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74b3ae-06a9-498c-828c-2f4c52997fba admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:53.934658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:53.935460 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:53.935748 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:53.936027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:53.936724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:53.939333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:54.063788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1221/2409] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:39:53 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:39:54.065057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:54.075647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c52c1-1787-4580-959b-43e4b4353443 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:54.081734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:54.082598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:54.082962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:54.083343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:54.084293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:54.085998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:54.097877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1189/2410] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:54.102354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:54.113177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7ac8e-444c-4bd1-8e34-b63dcac6dedd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:54.118155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:54.118838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:54.119127 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:54.119437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:54.120177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:54.121798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e562d5e-ce45-4af9-a45f-0bb1af7da068 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:54.135867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1222/2411] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:39:54.139954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:54.150598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcce491-1a06-4001-96c2-1d5df0b4fae0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:54.155902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:54.156811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:54.157129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:54.157408 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] PATH_INFO: `/v3/projects/342c3696e20244888b1e71b113d306fb/users/598c00cf28b149c2967e067293ee2170/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:54.175391 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342c3696e20244888b1e71b113d306fb, user_id=598c00cf28b149c2967e067293ee2170, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:54.178026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:54.260020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1190/2412] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:39:54 2022] PUT /identity/v3/projects/342c3696e20244888b1e71b113d306fb/users/598c00cf28b149c2967e067293ee2170/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:39:54.265159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87636-7670-4a77-b8c4-cd8f376357b7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:54.265458 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87636-7670-4a77-b8c4-cd8f376357b7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:54.265747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec87636-7670-4a77-b8c4-cd8f376357b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:54.287206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-aec87636-7670-4a77-b8c4-cd8f376357b7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:54.288473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-aec87636-7670-4a77-b8c4-cd8f376357b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:54.398032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1223/2413] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:54.408572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:54.410874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:54.477211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0910a4-a191-4bab-852c-d269e935a7a5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:54.492461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:54.493446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:54.493939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:54.494321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:54.512297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:54.513674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c7cb-6416-4b25-b0c5-f7b2b3f358d1 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:54.525933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1191/2414] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:39:56.017529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:56.018163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:56.018163 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:56.083332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] MFA Rules not processed for user `598c00cf28b149c2967e067293ee2170`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:56.084559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:56.206562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1224/2415] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:56.217648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:56.218239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:56.218239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:56.243320 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] MFA Rules not processed for user `598c00cf28b149c2967e067293ee2170`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:39:56.244941 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:56.254161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1192/2416] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:39:56.266156 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:39:56.267873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:39:56.385421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f864d95-c39b-4cb9-8485-4c969806c5a6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:39:56.405246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:39:56.406211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:39:56.406527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:39:56.407521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:39:56.418639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:39:56.420434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202ee73-6734-4d5b-9a9e-576295eb41bd service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:39:56.429922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1225/2417] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:39:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:00.514747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:00.516771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:00.531044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4a354-31ba-4280-8687-83332d5e8665 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:00.536612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:00.537785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:00.538143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:00.538634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] PATH_INFO: `/v3/users/8ec597e22797438e86740641dbdfb636` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:00.539875 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec597e22797438e86740641dbdfb636)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:00.541819 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:00.773238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec597e22797438e86740641dbdfb636'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:00.784206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec597e22797438e86740641dbdfb636'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:00.886845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec597e22797438e86740641dbdfb636'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:00.887782 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec597e22797438e86740641dbdfb636'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:00.889051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec597e22797438e86740641dbdfb636'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:00.916132 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1193/2418] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:40:00 2022] DELETE /identity/v3/users/8ec597e22797438e86740641dbdfb636 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:00.921367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:00.922649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:00.923457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:00.949558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:00.955891 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:01.033795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1226/2419] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:01.044634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:01.046433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:01.114735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e5df-4aa3-4ba3-9c21-18dc48c5319a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:01.119156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:01.119923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:01.120331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:01.120829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:01.138715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:01.140385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb41fb-3670-4fff-b80c-db4ef7a748d2 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:01.157635 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1194/2420] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:40:01.965698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:01.967169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:01.980575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5aef8-3861-401d-8338-ea9c5b1dda1b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:02.001781 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:02.003026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.003395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.003727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] PATH_INFO: `/v3/projects/8282009afb72407f95c12fd499928364` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.009131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8282009afb72407f95c12fd499928364)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:02.012385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:02.168907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8282009afb72407f95c12fd499928364', 'request_id': 'req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:02.176435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8282009afb72407f95c12fd499928364', 'request_id': 'req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:02.192099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8282009afb72407f95c12fd499928364', 'request_id': 'req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:02.271630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] The token cache is being invalidate because project 8282009afb72407f95c12fd499928364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:40:02.274394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:02.274394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ec9ed4b9-6c8e-4cd7-9840-a6dba0c11099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:02.275287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1227/2421] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:40:01 2022] DELETE /identity/v3/projects/8282009afb72407f95c12fd499928364 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:02.282816 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11beb-72b8-4a80-8f36-77c420803fa4 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.283445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11beb-72b8-4a80-8f36-77c420803fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.283445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d11beb-72b8-4a80-8f36-77c420803fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.305890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.306418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.306871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.329977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:02.331523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:02.337491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-17d11beb-72b8-4a80-8f36-77c420803fa4 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:02.339522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-17d11beb-72b8-4a80-8f36-77c420803fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:02.409608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1228/2422] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:40:02.425569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:02.425569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:02.436336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1195/2423] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:02.445637 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.445937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.446215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.496202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:02.497548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:02.547934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1196/2424] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:40:02.553801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:02.557399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8c03-3237-4b91-bbdb-e44b94669133 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:02.563053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:02.563833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.569347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.569347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.571281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb380024-1b93-40e3-b69a-8e56e3fae0a8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:02.580360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:02.581884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:02.585174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:02.585850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.586131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.586403 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.587129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:40:02.587461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:02.590946 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:02.591538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1229/2425] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:40:02.612894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1197/2426] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:40:02.616900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:02.629446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aacad0-9457-4239-b518-1333f1ee94de service swift] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:02.650084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:02.651983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.652281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.652587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.653296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:02.655344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:02.793253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1230/2427] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:40:02 2022] POST /identity/v3/projects => generated 391 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:40:02.794624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:02.814456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa74311-a8d2-4860-9f13-b0ef22610821 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:02.925218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:02.926813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:02.927736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:02.928028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:02.930296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:02.936567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:03.067346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1198/2428] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:40:02 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:40:03.070061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:03.088643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c472ee2-386e-413f-809b-d6dd398c8861 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:03.100038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:03.100777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:03.102676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:03.102992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:03.106190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:03.110523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:03.139969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1231/2429] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:40:03.144465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:03.159125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee67cf-689b-4bc1-a637-4816012bb1cf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:03.166973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:03.168949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:03.169244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:03.171267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:03.173679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:03.179987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c2850-a3bf-4f06-a1e9-a045ed9212fe admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:03.201867 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1199/2430] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:40:03.206971 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:03.220217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8175b-5d0f-473f-9a03-a4408d66200d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:03.230817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:03.232059 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:03.232370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:03.232712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] PATH_INFO: `/v3/projects/6712316f869f41bba8347ca6155e8000/users/96a16e1bd8404b5d825254a4a1acc001/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:03.273681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6712316f869f41bba8347ca6155e8000, user_id=96a16e1bd8404b5d825254a4a1acc001, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:03.276756 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:03.373322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1232/2431] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:40:03 2022] PUT /identity/v3/projects/6712316f869f41bba8347ca6155e8000/users/96a16e1bd8404b5d825254a4a1acc001/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:03.374876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:03.375557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:03.375557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:03.475016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] MFA Rules not processed for user `96a16e1bd8404b5d825254a4a1acc001`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:03.481147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:03.624407 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1200/2432] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:40:03.627335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:03.630721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:03.723860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e9ce-3e0e-434a-837c-b16219f3a687 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:03.735154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:03.735579 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:03.736418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:03.736418 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:03.747205 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:03.748705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa97f-c66e-4479-8dac-faae96e4617d service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:03.760134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1233/2433] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:17.373733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:17.375149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:17.462968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859d0d4-cedc-42a7-9d28-ec86f5213d51 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:17.468110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:17.468701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:17.469007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:17.469271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:17.471041 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:17.482024 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:17.483645 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:17.494170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1201/2434] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:18.978981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789a00-f207-43ca-976b-a6a61fd24690 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:18.979501 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789a00-f207-43ca-976b-a6a61fd24690 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:18.979604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789a00-f207-43ca-976b-a6a61fd24690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:18.996959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5a789a00-f207-43ca-976b-a6a61fd24690 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:18.998150 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5a789a00-f207-43ca-976b-a6a61fd24690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:19.052809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1234/2435] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:19.074670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:19.150783 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482c11e-809e-412c-833a-9d6181472fe8 service placement] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:19.157120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:19.157855 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:19.158265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:19.158554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:19.166879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:19.168482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:19.178061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1202/2436] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:40:20.125538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48167-c7d0-4c86-9b92-c8ca8a601fa8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:20.125936 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48167-c7d0-4c86-9b92-c8ca8a601fa8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:20.126155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48167-c7d0-4c86-9b92-c8ca8a601fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:20.143968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ecf48167-c7d0-4c86-9b92-c8ca8a601fa8 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:20.145159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ecf48167-c7d0-4c86-9b92-c8ca8a601fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:20.152597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1235/2437] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:20.165802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:20.176596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2e9d7-ae75-4a9f-aaea-73f8aae4c421 service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:20.181862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:20.182503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:20.182790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:20.183069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:20.191091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:20.192690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:20.200658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1203/2438] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:40:20.742961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4034bd-e0f5-455f-bcd5-310a0221b9b6 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:20.743254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4034bd-e0f5-455f-bcd5-310a0221b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:20.743588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4034bd-e0f5-455f-bcd5-310a0221b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:20.762152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8a4034bd-e0f5-455f-bcd5-310a0221b9b6 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:20.763368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8a4034bd-e0f5-455f-bcd5-310a0221b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:20.770929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1236/2439] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:20.782955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:20.793302 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8866ae-91a6-450f-9654-943040893880 service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:20.799182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:20.799862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:20.800180 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:20.800461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:20.808491 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:20.810073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:20.817984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1204/2440] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:40:21.341171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:21.341607 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:21.341733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:21.359503 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:21.360679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:21.367713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1237/2441] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:21.380029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:21.390284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d027f-ddc0-409c-b718-fd1ba2a0ab13 service swift] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:21.396229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:21.396868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:21.397152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:21.397456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:21.405729 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:21.408145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b643e80-6ffc-4e3f-bb6d-27b71c24fb0e service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:21.415958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1205/2442] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:40:24.390248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:24.392313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:24.457742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf78eae-2b02-4e92-972d-d88e5d6ec4fb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:24.462298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:24.463155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:24.463475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:24.463755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] PATH_INFO: `/v3/users/b4086aa939fb4870b24557f130f054be` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:24.464933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4086aa939fb4870b24557f130f054be)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:24.466816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:24.648705 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4086aa939fb4870b24557f130f054be'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:24.657144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4086aa939fb4870b24557f130f054be'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:24.750703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4086aa939fb4870b24557f130f054be'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:24.751480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4086aa939fb4870b24557f130f054be'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:24.752362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4086aa939fb4870b24557f130f054be'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:24.798277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1238/2443] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:40:24 2022] DELETE /identity/v3/users/b4086aa939fb4870b24557f130f054be => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:24.803527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:24.805050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:24.805554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:24.824421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:24.825743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:24.907066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1206/2444] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:24.919291 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:24.921693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:24.994455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37fe53-8d0b-49ee-b2c2-494a9917ed24 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:24.998537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:24.999467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:24.999844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:25.000180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:25.012508 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:25.014103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:25.038496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1239/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:25.311608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:25.313409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:25.335061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fbc8f-4472-493d-a4b4-e8ae24125656 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:25.342948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:25.343773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:25.344113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:25.345013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] PATH_INFO: `/v3/projects/5fe5bd19f913484c8a91d07243db2dee` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:25.346241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe5bd19f913484c8a91d07243db2dee)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:25.348190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:25.424799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe5bd19f913484c8a91d07243db2dee', 'request_id': 'req-b1feb407-6e79-4e48-8129-8b6d48c9b121'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:25.430872 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe5bd19f913484c8a91d07243db2dee', 'request_id': 'req-b1feb407-6e79-4e48-8129-8b6d48c9b121'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:25.436709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe5bd19f913484c8a91d07243db2dee', 'request_id': 'req-b1feb407-6e79-4e48-8129-8b6d48c9b121'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:25.522587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] The token cache is being invalidate because project 5fe5bd19f913484c8a91d07243db2dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:40:25.522880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:25.523595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-b1feb407-6e79-4e48-8129-8b6d48c9b121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:25.525260 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1207/2446] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:40:25 2022] DELETE /identity/v3/projects/5fe5bd19f913484c8a91d07243db2dee => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:29.378922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:29.380658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:29.395259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86394ff-4786-4f90-99b7-8a28b9e1e295 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:29.459490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:29.460564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:29.460854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:29.461137 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] PATH_INFO: `/v3/users/6c8284a6d8404a34bf1957d366ba8456` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:29.462328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8284a6d8404a34bf1957d366ba8456)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:29.464317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:29.645206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8284a6d8404a34bf1957d366ba8456'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:29.652661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8284a6d8404a34bf1957d366ba8456'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:29.749284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8284a6d8404a34bf1957d366ba8456'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:29.750227 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8284a6d8404a34bf1957d366ba8456'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:29.751198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8284a6d8404a34bf1957d366ba8456'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:29.770371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1240/2447] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:40:29 2022] DELETE /identity/v3/users/6c8284a6d8404a34bf1957d366ba8456 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:29.775664 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:29.776174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:29.776395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:29.796080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:29.798251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:29.864405 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1208/2448] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:29.874878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:29.876991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:29.947364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ec956-f0a3-48cd-a2b9-b70077b915e4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:29.951890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:29.952673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:29.953432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:29.953432 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:29.964279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:29.973328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306cc3c-89b4-4be7-b71d-dd55215aec00 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:29.991777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1241/2449] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:30.467032 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:30.468616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:30.486962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93ab0c-2cbc-4d0a-bb0f-2ab6a4885139 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:30.500306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:30.501179 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:30.501460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:30.501736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] PATH_INFO: `/v3/projects/b00bbb59b46e4938b28f27c7579fb6c2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:30.502935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00bbb59b46e4938b28f27c7579fb6c2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:30.505038 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:30.613161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00bbb59b46e4938b28f27c7579fb6c2', 'request_id': 'req-42c5d567-a4e6-422f-adb9-649f271d7ce9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:30.619537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00bbb59b46e4938b28f27c7579fb6c2', 'request_id': 'req-42c5d567-a4e6-422f-adb9-649f271d7ce9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:30.625896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00bbb59b46e4938b28f27c7579fb6c2', 'request_id': 'req-42c5d567-a4e6-422f-adb9-649f271d7ce9'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:30.720360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] The token cache is being invalidate because project b00bbb59b46e4938b28f27c7579fb6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:40:30.720644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:30.721279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:30.722850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1209/2450] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:40:30 2022] DELETE /identity/v3/projects/b00bbb59b46e4938b28f27c7579fb6c2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:33.415959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:33.416580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:33.416864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:33.435932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:33.437136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:33.491042 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1242/2451] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:33.503565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:33.505008 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:33.576910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d567-a4e6-422f-adb9-649f271d7ce9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:33.582555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:33.583215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:33.583533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:33.583815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:33.591939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:33.593661 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c6641-7feb-47eb-ad85-67404f69f910 service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:33.602227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1210/2452] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:40:34.795045 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:34.796495 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:34.868138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57e743-1631-49a4-84f2-a24677c18f73 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:34.871472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:34.872343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:34.872628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:34.872906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] PATH_INFO: `/v3/users/96a16e1bd8404b5d825254a4a1acc001` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:34.874274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a16e1bd8404b5d825254a4a1acc001)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:34.878461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:35.104444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a16e1bd8404b5d825254a4a1acc001'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:35.126874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a16e1bd8404b5d825254a4a1acc001'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:35.246963 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a16e1bd8404b5d825254a4a1acc001'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:35.247713 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a16e1bd8404b5d825254a4a1acc001'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:35.248322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a16e1bd8404b5d825254a4a1acc001'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:35.266420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1243/2453] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:40:34 2022] DELETE /identity/v3/users/96a16e1bd8404b5d825254a4a1acc001 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:35.271538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:35.272045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:35.272185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:35.293755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:35.294975 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:35.360518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1211/2454] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:35.370310 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:35.371855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:35.434805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ba145-a9b6-45b2-bb29-1416a834d75b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:35.438799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:35.439491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:35.439779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:35.440061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:35.449693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:35.451031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e0a71-0695-4c1c-964c-f4d0c34c5097 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:35.464367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1244/2455] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:35.900091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:35.901627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:35.913958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a09bb-ac94-4c83-bb63-7fbcbd8cdb74 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:35.918871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:35.919939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:35.920222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:35.920499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] PATH_INFO: `/v3/projects/6712316f869f41bba8347ca6155e8000` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:35.921746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6712316f869f41bba8347ca6155e8000)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:35.923904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.077648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6712316f869f41bba8347ca6155e8000', 'request_id': 'req-11816685-1693-4abc-b1fa-39fcf4221024'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:36.084505 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6712316f869f41bba8347ca6155e8000', 'request_id': 'req-11816685-1693-4abc-b1fa-39fcf4221024'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:36.089968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6712316f869f41bba8347ca6155e8000', 'request_id': 'req-11816685-1693-4abc-b1fa-39fcf4221024'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:36.166759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] The token cache is being invalidate because project 6712316f869f41bba8347ca6155e8000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:40:36.166983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:36.167652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-11816685-1693-4abc-b1fa-39fcf4221024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:40:36.169254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1212/2456] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:40:35 2022] DELETE /identity/v3/projects/6712316f869f41bba8347ca6155e8000 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:36.174399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.174873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.175017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.194046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:36.195363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:36.259758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1245/2457] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:36.267544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.268120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.269006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.290548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:36.292593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:36.303433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1213/2458] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:36.314567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.326880 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c28c2d-d9db-4f00-815f-90897fd63fbe None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.333853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.334856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.335171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.335441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.336178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:40:36.336517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.338236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.354631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1246/2459] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:40:36.355784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.366104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822d2f0-5099-4541-a7a8-c748a0f6a929 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.370878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.371598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.371963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.372186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.373006 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.374925 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.472972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1214/2460] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:40:36 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:40:36.477425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.487270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646f81-52c5-48d7-9339-9fa56ea64b40 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.543644 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.544322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.544609 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.544888 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.545604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.547763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.637295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1247/2461] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:40:36 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:40:36.643444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.654542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515861-189d-4a8d-b60d-bc7471617489 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.659755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.660485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.666699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.666699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.666699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.666699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.674289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1215/2462] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:40:36.678030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.689847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabbae2-8815-4cb7-a120-10ae06be75db admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.694688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.696908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.696908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.696908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.696908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.698407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54866-93b8-4965-9db7-3ce8bd2856f9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.711340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1248/2463] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:40:36.715766 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.727131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c86b58-16a6-4462-8fed-0cbabbdfa508 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:36.732807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:36.733974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.735242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.735577 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] PATH_INFO: `/v3/projects/b11ed249505a4004b9ac29e6e0d515ff/users/abb204e5377544b09ceb754b8a9bd072/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.755273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11ed249505a4004b9ac29e6e0d515ff, user_id=abb204e5377544b09ceb754b8a9bd072, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:36.758186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:36.865410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1216/2464] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:40:36 2022] PUT /identity/v3/projects/b11ed249505a4004b9ac29e6e0d515ff/users/abb204e5377544b09ceb754b8a9bd072/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:36.870752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:36.871056 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:36.871374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:36.889349 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:36.890560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:36.948593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1249/2465] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:36.958620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:36.960348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:37.017634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b6f51-29a4-4205-940a-0a35ac5347a1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:37.021315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:37.021957 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:37.022245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:37.022525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:37.031810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:37.033246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0654-bffb-4f8e-8311-432688994356 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:37.042705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1217/2466] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:37.931531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:37.942067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be345c-e37d-4e71-a893-0ace1ec89f31 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:37.946448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:37.947333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:37.947679 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:37.948023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:37.950565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:38.028034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:38.029493 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:38.040656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1250/2467] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:40:43.340615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:43.344702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:43.344702 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:43.374063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] MFA Rules not processed for user `abb204e5377544b09ceb754b8a9bd072`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:43.375212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:43.454322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1218/2468] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:43.458922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:43.472740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ec3be-4a26-4ee1-a1ed-9582acd71618 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:43.481823 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:43.485876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:43.487068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:43.487745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:43.488930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:43.491420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:43.588910 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1251/2469] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:40:43 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:40:43.592889 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:43.604249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc349a-2a5c-4a5e-b258-7537922a3371 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:43.666194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:43.666877 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:43.667229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:43.667539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:43.668247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:43.670178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:43.768395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1219/2470] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:40:43 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:40:43.772559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:43.787991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e00a2-6cda-4fbc-bb4c-61be5f677d0e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:43.796011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:43.796011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:43.796011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:43.796011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:43.796655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:43.797530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:43.811342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1252/2471] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:40:43.814105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:43.830655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2e16-2be3-432d-aeeb-d6ab5e825211 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:43.840788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:43.842121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:43.842424 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:43.842709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] PATH_INFO: `/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2/users/261bd85a933e476381cf915ce665db68/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:43.861144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccdb6f99e4a4de3a13689f10ec2c9f2, user_id=261bd85a933e476381cf915ce665db68, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:43.864139 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:43.941387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1220/2472] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:40:43 2022] PUT /identity/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2/users/261bd85a933e476381cf915ce665db68/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:43.945569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:43.957178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edc680-6a3c-4f09-8090-5cd274d39d5b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:44.020587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:44.021281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:44.021567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:44.021850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:44.022586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:44.024451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05650-f484-4f39-bc67-df7c2d04aa34 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:44.038082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1253/2473] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:40:44.040663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:44.051549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1c4ee-4b0c-48a6-8ca5-7e78cf25aa4a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:44.057445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:44.058677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:44.058968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:44.059453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] PATH_INFO: `/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2/users/261bd85a933e476381cf915ce665db68/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:44.063202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccdb6f99e4a4de3a13689f10ec2c9f2, user_id=261bd85a933e476381cf915ce665db68, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:44.066317 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233ed4-0368-461a-92bc-66594c5c7ce7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:44.077682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1221/2474] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:40:44 2022] PUT /identity/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2/users/261bd85a933e476381cf915ce665db68/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:40:45.047091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:45.048330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:45.049276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:45.074083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] MFA Rules not processed for user `598c00cf28b149c2967e067293ee2170`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:45.075719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:45.162536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1254/2475] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:51.680666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:51.681145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:51.681262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:51.708961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] MFA Rules not processed for user `261bd85a933e476381cf915ce665db68`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:40:51.710556 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:51.780457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1222/2476] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:40:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:40:51.797613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:40:51.799051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:40:51.873532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87268426-c7bc-4565-84c3-0f42c6e4e135 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:40:51.880441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:40:51.881620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:40:51.881620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:40:51.881808 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:40:51.948025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:40:51.949624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91849d-edc7-4245-8295-604298565b5e service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:40:51.959618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1255/2477] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:40:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:41:00.801212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:41:00.802667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:00.862997 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361e1f3-7479-478a-9923-891f8755c86d None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:41:00.866466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:41:00.867100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:00.867412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:00.867689 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:00.869418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:00.931920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:41:00.933343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68048bbb-1193-47a0-bcab-5cd6c14a123a service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:41:00.943092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1223/2478] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:41:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:41:05.134082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e0d-329e-4426-93e7-88a0c5951242 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:05.134599 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e0d-329e-4426-93e7-88a0c5951242 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:05.134715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e0d-329e-4426-93e7-88a0c5951242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:05.152541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-14285e0d-329e-4426-93e7-88a0c5951242 None None] MFA Rules not processed for user `598c00cf28b149c2967e067293ee2170`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:41:05.153696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-14285e0d-329e-4426-93e7-88a0c5951242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:05.161388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1256/2479] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:41:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:41:14.440959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:14.441477 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:14.441561 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:14.459168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] MFA Rules not processed for user `abb204e5377544b09ceb754b8a9bd072`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:41:14.460411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:14.467654 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1224/2480] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:41:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:41:34.318353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69835e-6393-4472-877d-4fd223c0e6ca None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:34.322469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69835e-6393-4472-877d-4fd223c0e6ca None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:34.322469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69835e-6393-4472-877d-4fd223c0e6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:34.338578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-be69835e-6393-4472-877d-4fd223c0e6ca None None] MFA Rules not processed for user `598c00cf28b149c2967e067293ee2170`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:41:34.339844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-be69835e-6393-4472-877d-4fd223c0e6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:34.350833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1257/2481] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:41:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:41:37.059999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:41:37.070161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54111923-4eac-424a-a191-1ed1790e4856 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:41:37.074057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:41:37.074769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:37.075121 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:37.075544 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:37.085329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:41:37.086873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31dd5a-23a0-4780-97ff-e467e44b2b53 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:41:37.107406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1225/2482] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:41:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:41:44.922692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:44.923266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:44.923266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:44.943149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] MFA Rules not processed for user `765e2a7f731c4facbb94fe8117e0053c`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:41:44.944413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:45.002381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1258/2483] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:41:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:41:46.459976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:46.460428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:46.460542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:46.478120 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] MFA Rules not processed for user `d4d9ee91364a45d8b423814654f2acc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:41:46.479340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:46.532630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1226/2484] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:41:55.344754 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:41:55.354407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaded-0841-4a5e-ad0f-bdf65dc168a5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:41:55.357954 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:41:55.359200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:55.359530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:55.359812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:55.361689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:55.375621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:41:55.378964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:41:55.390600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1259/2485] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:41:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:41:57.919143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:41:57.928825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac53b3-ea9f-4ac6-81dd-7f568d8737ea None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:41:57.932579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:41:57.933222 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:41:57.933511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:41:57.933789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:41:57.935587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:41:57.949137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:41:57.950554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:41:57.961942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1227/2486] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:41:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:09.537336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:09.538641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:09.601598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe134-3a16-4ee3-9de9-cf760b26754d service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:09.735535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:09.735535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:09.735535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:09.735535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:09.737018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:09.737018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:09.737018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:09.737018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1260/2487] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:17.108683 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:17.130130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c57a7-6c8a-4b19-8e9f-b060f8023831 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:17.148579 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:17.149519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:17.149964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:17.150415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:17.152849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:17.169319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:17.171539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23933b4d-b1f0-441a-ae4d-7f1cf558f1ad service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:17.185843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1228/2488] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:42:17.344778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:17.354388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c361f-2df0-4b3a-8658-3513cf9fa339 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:17.364242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:17.365112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:17.365601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:17.366064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:17.368361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:17.379937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:17.381867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:17.402551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1261/2489] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:28.069035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:28.069571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:28.069571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:28.090198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:28.091425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:28.145634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1229/2490] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:42:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:28.278843 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:28.280071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:28.348557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf932f7-cb7f-4710-bc08-3370769e1778 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:28.353662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:28.354310 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:28.354601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:28.354884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:28.362942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:28.364613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:28.372665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1262/2491] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:42:31.917272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:31.918715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:31.986235 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5345a0-4b85-4e56-8ad9-837df263e33e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:31.990954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:31.991876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:31.992161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:31.992435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] PATH_INFO: `/v3/users/598c00cf28b149c2967e067293ee2170` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:31.993644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598c00cf28b149c2967e067293ee2170)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:31.995582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:32.199012 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598c00cf28b149c2967e067293ee2170'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:32.210262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598c00cf28b149c2967e067293ee2170'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:32.279602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598c00cf28b149c2967e067293ee2170'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:32.280244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598c00cf28b149c2967e067293ee2170'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:32.280879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4f433b5-3599-4db7-b192-a8579b54d742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598c00cf28b149c2967e067293ee2170'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:32.300257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1230/2492] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:31 2022] DELETE /identity/v3/users/598c00cf28b149c2967e067293ee2170 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:32.778677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:32.814989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba796-fccd-4a80-9187-456577334e9d service swift] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:32.892933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:32.892933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:32.892933 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:32.893907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] PATH_INFO: `/v3/projects/342c3696e20244888b1e71b113d306fb` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:32.896221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342c3696e20244888b1e71b113d306fb)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:32.898683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.011097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342c3696e20244888b1e71b113d306fb', 'request_id': 'req-1c520180-e8cd-4740-98be-23f5a2792880'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:33.020712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342c3696e20244888b1e71b113d306fb', 'request_id': 'req-1c520180-e8cd-4740-98be-23f5a2792880'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:33.028234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342c3696e20244888b1e71b113d306fb', 'request_id': 'req-1c520180-e8cd-4740-98be-23f5a2792880'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:33.087551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] The token cache is being invalidate because project 342c3696e20244888b1e71b113d306fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:33.088231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:33.089235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-1c520180-e8cd-4740-98be-23f5a2792880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:33.091867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1263/2493] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:32 2022] DELETE /identity/v3/projects/342c3696e20244888b1e71b113d306fb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:33.096653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.097174 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.097347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.118056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:33.119427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:33.179624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1231/2494] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:33.187144 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.187476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.187763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.206953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:33.208140 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:33.220228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1264/2495] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:33.221527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.234083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f162d03-10d1-48e3-8bf8-7f72d97411df None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.241581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.243450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.243578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.243768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.244518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:42:33.244832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.246470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.261521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1232/2496] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:42:33.273289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.284916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef582fd-b45c-4e3a-9ec9-5f1961f16a06 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.293385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.294032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.297494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.297787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.299277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.302435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.410586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1265/2497] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:42:33 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:33.411851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.421802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb8fb-05e9-4bf2-ac22-bf377da22977 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.478799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.481058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.481058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.481058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.481058 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.482739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.578499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1233/2498] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:42:33 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:33.581441 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.592712 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce6aa6-f2c0-42df-8448-c3455cda3400 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.597902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.600098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.600098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.600098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.600098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.601635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.618154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1266/2499] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:33.619638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.630757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a64f7-bcfc-4d61-913e-017e25705c02 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.635775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.636603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.636891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.637192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.637934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.639910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacb655-48a9-44e6-b3ac-59c645e2bade admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.655418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1234/2500] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:33.656848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.667533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2567-cc02-4ecc-8a3f-576a8f64f1a9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.672428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.673370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.673657 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.673937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] PATH_INFO: `/v3/projects/cfba89f1996344a7bfd79c8f9108230f/users/9afcad9ab90843ec9f624338957bf929/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.690086 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfba89f1996344a7bfd79c8f9108230f, user_id=9afcad9ab90843ec9f624338957bf929, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.692791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.749240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1267/2501] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:33 2022] PUT /identity/v3/projects/cfba89f1996344a7bfd79c8f9108230f/users/9afcad9ab90843ec9f624338957bf929/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:33.760919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.761220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.761507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.788587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] MFA Rules not processed for user `9afcad9ab90843ec9f624338957bf929`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:33.789836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:33.853785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1235/2502] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:33.864788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:33.866514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:33.941180 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ee51-212c-484d-b82c-6898fda2b14c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:33.947244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:33.947942 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:33.949676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:33.949676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:33.957752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:33.959362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:33.968457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1268/2503] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:37.356279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:37.357704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:37.423516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94e4df-85b7-48fd-8b35-80db3e724466 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:37.428599 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:37.429488 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:37.429771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:37.430046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] PATH_INFO: `/v3/users/5bbf59c9cfa74b529796534e4b266eef` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:37.431249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbf59c9cfa74b529796534e4b266eef)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:37.433166 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:37.600377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbf59c9cfa74b529796534e4b266eef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:37.606870 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbf59c9cfa74b529796534e4b266eef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:37.679077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbf59c9cfa74b529796534e4b266eef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:37.679733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbf59c9cfa74b529796534e4b266eef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:37.680357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbf59c9cfa74b529796534e4b266eef'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:37.697717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1236/2504] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:37 2022] DELETE /identity/v3/users/5bbf59c9cfa74b529796534e4b266eef => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:37.907125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:37.915337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123fdfd-f087-4460-97f5-1fc23ec35b97 service nova] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:37.971938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:37.972795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:37.973082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:37.973360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] PATH_INFO: `/v3/projects/260e21310ae841e58241553c88e18795` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:37.974539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260e21310ae841e58241553c88e18795)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:37.976478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:38.078651 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260e21310ae841e58241553c88e18795', 'request_id': 'req-3f477157-789f-4653-9a70-866d7bb77897'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.084682 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260e21310ae841e58241553c88e18795', 'request_id': 'req-3f477157-789f-4653-9a70-866d7bb77897'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.089958 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260e21310ae841e58241553c88e18795', 'request_id': 'req-3f477157-789f-4653-9a70-866d7bb77897'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.198583 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] The token cache is being invalidate because project 260e21310ae841e58241553c88e18795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:38.198800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.199468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.200988 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1269/2505] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:37 2022] DELETE /identity/v3/projects/260e21310ae841e58241553c88e18795 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:38.204967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:38.206369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:38.218993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef7a7-eedd-401c-b337-372d81c907eb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:38.273347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:38.274224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:38.274517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:38.274795 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] PATH_INFO: `/v3/users/ed04ae53959b4dfe9cbee253a115e4a1` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:38.275999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed04ae53959b4dfe9cbee253a115e4a1)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:38.277895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:38.467640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed04ae53959b4dfe9cbee253a115e4a1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.475415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed04ae53959b4dfe9cbee253a115e4a1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.565262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed04ae53959b4dfe9cbee253a115e4a1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.566078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed04ae53959b4dfe9cbee253a115e4a1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.566698 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed04ae53959b4dfe9cbee253a115e4a1'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:38.584652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1237/2506] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:38 2022] DELETE /identity/v3/users/ed04ae53959b4dfe9cbee253a115e4a1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:38.806819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:38.808391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:38.821904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f477157-789f-4653-9a70-866d7bb77897 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:38.878376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:38.879234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:38.879554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:38.879836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] PATH_INFO: `/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:38.881019 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f29f947ae24ac897d2b7c23824c2ea)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:38.882919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:39.009858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f29f947ae24ac897d2b7c23824c2ea', 'request_id': 'req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:39.015865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f29f947ae24ac897d2b7c23824c2ea', 'request_id': 'req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:39.021815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f29f947ae24ac897d2b7c23824c2ea', 'request_id': 'req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:39.089886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] The token cache is being invalidate because project a7f29f947ae24ac897d2b7c23824c2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:39.090177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:39.090793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-844e3fed-d9e2-4985-b99c-a3f4ef275fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:39.092398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1270/2507] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:38 2022] DELETE /identity/v3/projects/a7f29f947ae24ac897d2b7c23824c2ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:43.155743 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:43.157157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:43.169852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4251e-7ad2-497b-967e-15d18c23f931 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:43.224886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:43.225760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:43.226043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:43.226313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] PATH_INFO: `/v3/users/9afcad9ab90843ec9f624338957bf929` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:43.227540 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afcad9ab90843ec9f624338957bf929)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:43.229512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:43.390113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afcad9ab90843ec9f624338957bf929'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:43.396966 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afcad9ab90843ec9f624338957bf929'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:43.451210 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afcad9ab90843ec9f624338957bf929'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:43.451967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afcad9ab90843ec9f624338957bf929'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:43.452618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afcad9ab90843ec9f624338957bf929'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:43.471358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1238/2508] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:43 2022] DELETE /identity/v3/users/9afcad9ab90843ec9f624338957bf929 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:43.476262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:43.476750 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:43.476877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:43.497596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:43.499519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:43.573984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1271/2509] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:43.585916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:43.587466 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:43.646406 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbcfd6-44aa-4f7e-be68-564aa5670607 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:43.649972 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:43.650611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:43.650897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:43.651170 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:43.662833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:43.664290 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e7ae-ea03-4f33-831c-6d9ec0866608 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:43.675168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1239/2510] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:44.104332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.106752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:44.125537 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e477-3115-4e8d-a91a-61bb29feae20 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.131723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.132631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.132935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.133238 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] PATH_INFO: `/v3/projects/cfba89f1996344a7bfd79c8f9108230f` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.134502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfba89f1996344a7bfd79c8f9108230f)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.136476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.242845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfba89f1996344a7bfd79c8f9108230f', 'request_id': 'req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:44.249106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfba89f1996344a7bfd79c8f9108230f', 'request_id': 'req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:44.255273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfba89f1996344a7bfd79c8f9108230f', 'request_id': 'req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:44.332616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] The token cache is being invalidate because project cfba89f1996344a7bfd79c8f9108230f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:44.332901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:44.333543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-c88fb12b-bc59-4443-9dc3-a82ebdcd68b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:44.335101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1272/2511] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:44 2022] DELETE /identity/v3/projects/cfba89f1996344a7bfd79c8f9108230f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:44.340812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.341340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.341340 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.360267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:44.361801 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:44.440639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1240/2512] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:44.448421 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.448717 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.449002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.467191 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:44.468411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:44.476382 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1273/2513] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:44.480462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.490485 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e1627-5a02-4bf8-8687-6c669682a3a7 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.495119 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.495745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.496767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.496767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.496998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:42:44.497303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.498915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.511522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1241/2514] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:42:44.515862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.525131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb2eb-8bd2-4fa7-85f1-dc6ef73b557e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.530097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.530765 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.531053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.531422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.532132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.534330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.606772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1274/2515] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:42:44 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:42:44.611615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.621399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417564e8-24af-475c-87d3-1bac2749105a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.689368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.690442 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.690928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.691490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.692673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.696376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.806062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1242/2516] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:42:44 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:42:44.812381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.827009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c07ce-9d12-4392-9040-58cab9dd8687 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.832678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.834270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.834766 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.835279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.836693 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.839333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.855856 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1275/2517] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:44.860804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.871501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e98697-10b3-43c8-b396-5bd1b5481334 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.876218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.876882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.877168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.877454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.878183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.879871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa26d18-cd0b-4c5f-945e-ff3f8a2757dd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:44.890568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1243/2518] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:42:44.895028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:44.908473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c71517-c18d-4b4e-89c7-6b1c0f62d5d9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:44.913084 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:44.913959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:44.914243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:44.914521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] PATH_INFO: `/v3/projects/7ed5699acd954f0ba292a95f8db34820/users/3564ee1d2092443aa65c629d09cf03ba/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:44.934340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed5699acd954f0ba292a95f8db34820, user_id=3564ee1d2092443aa65c629d09cf03ba, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:44.937233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.030448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1276/2519] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:44 2022] PUT /identity/v3/projects/7ed5699acd954f0ba292a95f8db34820/users/3564ee1d2092443aa65c629d09cf03ba/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:45.041297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.041614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.041894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.072492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] MFA Rules not processed for user `3564ee1d2092443aa65c629d09cf03ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:45.073611 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:45.138183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1244/2520] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:45.144873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.217788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303a5b5-a8cd-4852-ab1d-9ba1df3fd890 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.224223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.225378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.225681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.225966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.226953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.229364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.309686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1277/2521] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:42:45 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:45.314902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.327640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e73584-08fb-4493-8ce3-283db88ce32a None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.404423 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.405129 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.405362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.405636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.406327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.409078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.485571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1245/2522] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:42:45 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:45.489386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.500112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82ed3-db82-47ed-a3a0-10b6033f973e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.506330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.506996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.507282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.507595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.508326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.511978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.525030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1278/2523] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:45.529315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.542732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57dc42-2382-4dff-859c-9c7a07eb315e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.550419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.551616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.551937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.552182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] PATH_INFO: `/v3/projects/6b056b206b3546f3a61f90e18a038153/users/aa71c3075fcd44ecb6b7b4acda68e7a9/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.575513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b056b206b3546f3a61f90e18a038153, user_id=aa71c3075fcd44ecb6b7b4acda68e7a9, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.580203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.657315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1246/2524] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:45 2022] PUT /identity/v3/projects/6b056b206b3546f3a61f90e18a038153/users/aa71c3075fcd44ecb6b7b4acda68e7a9/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:45.661703 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.671829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e712-5a56-4917-8c08-5034f1056852 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.727678 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.728342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.728626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.729425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.730243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.732587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333bc2-6692-4d87-ac55-bd7a2c57d6f1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.742531 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1279/2525] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:45.747394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.759133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8a59-4af4-42fc-8748-8c1903137d17 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.764646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.766178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.766178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.766178 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] PATH_INFO: `/v3/projects/6b056b206b3546f3a61f90e18a038153/users/aa71c3075fcd44ecb6b7b4acda68e7a9/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.771453 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b056b206b3546f3a61f90e18a038153, user_id=aa71c3075fcd44ecb6b7b4acda68e7a9, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.776068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:45.792725 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1247/2526] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:45 2022] PUT /identity/v3/projects/6b056b206b3546f3a61f90e18a038153/users/aa71c3075fcd44ecb6b7b4acda68e7a9/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:45.804407 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.804700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.804984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.832853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] MFA Rules not processed for user `aa71c3075fcd44ecb6b7b4acda68e7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:45.834083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:45.910890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1280/2527] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:45.920963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:45.923196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:45.981894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87d62a-7bc8-4bb2-9e46-1049d50d1876 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:45.986329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:45.986970 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:45.987250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:45.987551 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:45.996815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:45.998305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:46.008044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1248/2528] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:46.229535 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:46.240898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e6684-9d4d-49ec-b2d0-ac7f4b1778b5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:46.244961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:46.246017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:46.246509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:46.246981 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:46.312571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:46.314088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:46.325686 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1281/2529] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:53.242376 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:53.243902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:53.322940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783707a1-7198-419c-a4e2-e6a29cdc0e3d service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:53.328421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:53.332326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:53.332326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:53.332326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:53.332326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:53.388934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:53.390663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb24c1-9d84-4043-b262-6b05329c64ff service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:53.399719 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1249/2530] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:56.453295 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:56.522969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aedbd-2148-49e2-9d82-23af4f8072aa service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:56.527518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:56.528383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:56.528666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:56.528941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] PATH_INFO: `/v3/users/3564ee1d2092443aa65c629d09cf03ba` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:56.530107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3564ee1d2092443aa65c629d09cf03ba)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:56.532031 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:56.823965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3564ee1d2092443aa65c629d09cf03ba'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:56.830696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3564ee1d2092443aa65c629d09cf03ba'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:56.919259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3564ee1d2092443aa65c629d09cf03ba'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:56.919912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3564ee1d2092443aa65c629d09cf03ba'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:56.920635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3564ee1d2092443aa65c629d09cf03ba'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:56.938359 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1282/2531] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:56 2022] DELETE /identity/v3/users/3564ee1d2092443aa65c629d09cf03ba => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:56.942965 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:56.943501 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:56.943608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:56.960441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:56.961643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:57.019074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1250/2532] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:57.028718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:57.030129 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:57.087270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de64de-9f21-445f-8085-da33e7bdb47d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:57.090913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:57.091603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:57.098210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:57.098210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:57.101484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:57.102915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:57.113069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1283/2533] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:42:57.521333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:57.522755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:57.535672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff19bc-c09e-4171-9b87-fc4228a0f8d0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:57.540560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:57.541421 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:57.541710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:57.541990 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] PATH_INFO: `/v3/projects/7ed5699acd954f0ba292a95f8db34820` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:57.543266 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed5699acd954f0ba292a95f8db34820)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:57.545255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:57.639181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed5699acd954f0ba292a95f8db34820', 'request_id': 'req-7f2be384-2889-47e2-8fa7-1267120a67bc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.645922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed5699acd954f0ba292a95f8db34820', 'request_id': 'req-7f2be384-2889-47e2-8fa7-1267120a67bc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.651234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed5699acd954f0ba292a95f8db34820', 'request_id': 'req-7f2be384-2889-47e2-8fa7-1267120a67bc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.713861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] The token cache is being invalidate because project 7ed5699acd954f0ba292a95f8db34820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:57.714073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.714821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.716703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1251/2534] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:57 2022] DELETE /identity/v3/projects/7ed5699acd954f0ba292a95f8db34820 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:57.721021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:57.730539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bc2bd-da58-419e-b45e-038e97b1416f service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:57.787035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:57.787867 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:57.788156 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:57.788431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] PATH_INFO: `/v3/users/aa71c3075fcd44ecb6b7b4acda68e7a9` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:57.789628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa71c3075fcd44ecb6b7b4acda68e7a9)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:57.791608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:57.984224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa71c3075fcd44ecb6b7b4acda68e7a9'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:57.991631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa71c3075fcd44ecb6b7b4acda68e7a9'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.050853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa71c3075fcd44ecb6b7b4acda68e7a9'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.051473 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa71c3075fcd44ecb6b7b4acda68e7a9'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.052091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fde1da05-7440-42c4-9343-b3cae6a51cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa71c3075fcd44ecb6b7b4acda68e7a9'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.070563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1284/2535] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:42:57 2022] DELETE /identity/v3/users/aa71c3075fcd44ecb6b7b4acda68e7a9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:58.481905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:58.484641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:58.498127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be384-2889-47e2-8fa7-1267120a67bc admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:58.563411 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:58.564288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:58.564571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:58.564844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] PATH_INFO: `/v3/projects/6b056b206b3546f3a61f90e18a038153` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:58.566004 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b056b206b3546f3a61f90e18a038153)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:58.567939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:58.673910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b056b206b3546f3a61f90e18a038153', 'request_id': 'req-1c732965-60d3-4c49-a395-41abd763b952'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.679919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b056b206b3546f3a61f90e18a038153', 'request_id': 'req-1c732965-60d3-4c49-a395-41abd763b952'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.685092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b056b206b3546f3a61f90e18a038153', 'request_id': 'req-1c732965-60d3-4c49-a395-41abd763b952'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.735282 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] The token cache is being invalidate because project 6b056b206b3546f3a61f90e18a038153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:42:58.735620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.736284 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1c732965-60d3-4c49-a395-41abd763b952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:42:58.737779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1252/2536] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:42:58 2022] DELETE /identity/v3/projects/6b056b206b3546f3a61f90e18a038153 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:58.750585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:58.751111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:58.751207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:58.769489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:58.770817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:58.833621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1285/2537] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:58.841321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:58.841614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:58.841896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:58.860851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:58.862089 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:58.870994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1253/2538] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:42:58.875554 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:58.884681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69151df-26a3-45e3-8e55-7bc42c9cbe76 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:58.889241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:58.889905 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:58.890194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:58.890476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:58.891200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:42:58.891533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:58.893730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:58.905231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1286/2539] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:42:58.929131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:58.938209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d986f14-65ae-4964-98c1-4c056f19e270 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:58.942894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:58.943578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:58.943864 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:58.944135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:58.944825 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:58.946703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.034793 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1254/2540] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:42:58 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:59.038972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.048863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad768-c02d-4d16-8669-9da8691de474 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.103793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.104455 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.104742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.105025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.105716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.107670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.216618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1287/2541] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:42:59 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:59.220614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.230598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e5b38-bdb5-4b36-822d-2e8177b9bac0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.235226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.235910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.236194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.236465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.237181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.238747 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.248849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1255/2542] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:59.253268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.262877 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456a60-4136-4375-bbea-2910bbad4521 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.268142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.272937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.272937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.272937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.272937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.272937 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2d6d8-200f-4e74-b927-349847f74ac4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.281410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1288/2543] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:59.285633 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.295409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e4dc4-3747-4e6f-ae33-2600c13ce061 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.300145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.303794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.303794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.303794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] PATH_INFO: `/v3/projects/1d1ee42f37034828bbd49c71c09aa83e/users/4900172f381140f3a3d6d57f0c8c266f/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.316422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1ee42f37034828bbd49c71c09aa83e, user_id=4900172f381140f3a3d6d57f0c8c266f, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.319105 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.376350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1256/2544] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:59 2022] PUT /identity/v3/projects/1d1ee42f37034828bbd49c71c09aa83e/users/4900172f381140f3a3d6d57f0c8c266f/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:59.386574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.386874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.389816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.414427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] MFA Rules not processed for user `4900172f381140f3a3d6d57f0c8c266f`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:42:59.415659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:42:59.476869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1289/2545] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:42:59.481142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.548398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b2b8-c1b1-4ca2-b255-4a2d2777a138 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.553294 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.553958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.554241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.554517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.555218 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.557127 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.638657 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1257/2546] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:42:59 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:59.640023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.651274 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309263ea-9da6-4635-8686-d3c27b1a402a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.708186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.708851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.709136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.709413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.710087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.712041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.799322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1290/2547] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:42:59 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:42:59.803248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.814190 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13255-ff4a-427e-b19c-e367da206bbb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.818908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.819594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.819912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.820155 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.822306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.822461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.833514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1258/2548] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:42:59.837595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.847356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d77fe-1901-4552-9ddf-a485d3d8425d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:42:59.851923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:42:59.852785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:42:59.853068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:42:59.853337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] PATH_INFO: `/v3/projects/96e5ff9480af46f5861c0f71391181ad/users/9ad17218ec6648bb9ba5b9ed85a7dffc/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:42:59.868704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e5ff9480af46f5861c0f71391181ad, user_id=9ad17218ec6648bb9ba5b9ed85a7dffc, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:42:59.871339 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:42:59.965630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1291/2549] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:42:59 2022] PUT /identity/v3/projects/96e5ff9480af46f5861c0f71391181ad/users/9ad17218ec6648bb9ba5b9ed85a7dffc/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:42:59.969512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:42:59.979414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd65c76-7b76-49b5-bc66-7e979ea36da5 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:00.035794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:00.036465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:00.036752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:00.037027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:00.037744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:00.039359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58226-397d-4846-8819-6d69cddafee9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:00.052053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1259/2550] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:00.053399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:00.064315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f61de1-4b44-452c-880e-39e7efd6ff24 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:00.069088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:00.069969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:00.070256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:00.070536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] PATH_INFO: `/v3/projects/96e5ff9480af46f5861c0f71391181ad/users/9ad17218ec6648bb9ba5b9ed85a7dffc/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:00.072538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e5ff9480af46f5861c0f71391181ad, user_id=9ad17218ec6648bb9ba5b9ed85a7dffc, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:00.075225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:00.085932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1292/2551] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:00 2022] PUT /identity/v3/projects/96e5ff9480af46f5861c0f71391181ad/users/9ad17218ec6648bb9ba5b9ed85a7dffc/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:00.096948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:00.097243 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:00.097525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:00.123146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] MFA Rules not processed for user `9ad17218ec6648bb9ba5b9ed85a7dffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:00.124374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:00.190489 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1260/2552] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:00.201094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:00.202790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:00.258540 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799b70-c2ec-43fc-a7e5-6212d5b0edd8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:00.262235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:00.262908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:00.263195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:00.263522 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:00.272475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:00.273912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dcdea-c85c-412f-b5c9-ebf876f8c5ed service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:00.283808 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1293/2553] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:03.140007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:03.200574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600e0c9-f10c-41df-8d07-d3882a69e015 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:03.205104 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:03.206001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:03.206288 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:03.206564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] PATH_INFO: `/v3/users/4900172f381140f3a3d6d57f0c8c266f` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:03.207817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4900172f381140f3a3d6d57f0c8c266f)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:03.209707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:03.361021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4900172f381140f3a3d6d57f0c8c266f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:03.368198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4900172f381140f3a3d6d57f0c8c266f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:03.474230 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4900172f381140f3a3d6d57f0c8c266f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:03.474861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4900172f381140f3a3d6d57f0c8c266f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:03.475878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4900172f381140f3a3d6d57f0c8c266f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:03.495106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1261/2554] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:03 2022] DELETE /identity/v3/users/4900172f381140f3a3d6d57f0c8c266f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:03.499600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:03.500442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:03.500793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:03.518904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:03.520304 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:03.578928 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1294/2555] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:03.588541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:03.590140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:03.651142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c15f2-f318-4454-8075-411a697cdcd4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:03.654898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:03.655618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:03.655905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:03.656471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:03.666455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:03.667945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:03.678037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1262/2556] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:04.081311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:04.083976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:04.107848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39308c-decd-49bd-a4f8-f89253f0b0b5 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:04.113920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:04.115667 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:04.116340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:04.116638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] PATH_INFO: `/v3/projects/1d1ee42f37034828bbd49c71c09aa83e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:04.120664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1ee42f37034828bbd49c71c09aa83e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:04.120664 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:04.245769 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1ee42f37034828bbd49c71c09aa83e', 'request_id': 'req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.252256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1ee42f37034828bbd49c71c09aa83e', 'request_id': 'req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.258149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1ee42f37034828bbd49c71c09aa83e', 'request_id': 'req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.358538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] The token cache is being invalidate because project 1d1ee42f37034828bbd49c71c09aa83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:04.358829 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.360204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.361016 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1295/2557] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:04 2022] DELETE /identity/v3/projects/1d1ee42f37034828bbd49c71c09aa83e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:04.365474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:04.374738 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104bcaa-0796-40ed-b0a6-4c11b8092bf4 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:04.433834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:04.434984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:04.435271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:04.435583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] PATH_INFO: `/v3/users/9ad17218ec6648bb9ba5b9ed85a7dffc` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:04.436976 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad17218ec6648bb9ba5b9ed85a7dffc)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:04.438945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:04.635620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad17218ec6648bb9ba5b9ed85a7dffc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.642293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad17218ec6648bb9ba5b9ed85a7dffc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.708397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad17218ec6648bb9ba5b9ed85a7dffc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.709116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad17218ec6648bb9ba5b9ed85a7dffc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.709733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-5f2bb124-dc33-4ae2-bd8e-3682f4e31ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad17218ec6648bb9ba5b9ed85a7dffc'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:04.731467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1263/2558] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:04 2022] DELETE /identity/v3/users/9ad17218ec6648bb9ba5b9ed85a7dffc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:05.237818 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.239784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:05.253974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05dad9-cb5e-4e48-bc13-4f22b17f1562 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.316875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.317751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.318036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.318316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] PATH_INFO: `/v3/projects/96e5ff9480af46f5861c0f71391181ad` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.319538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e5ff9480af46f5861c0f71391181ad)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.321448 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.410608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e5ff9480af46f5861c0f71391181ad', 'request_id': 'req-ff26d1a1-490d-4597-94e3-260a995498d3'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:05.417032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e5ff9480af46f5861c0f71391181ad', 'request_id': 'req-ff26d1a1-490d-4597-94e3-260a995498d3'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:05.426612 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e5ff9480af46f5861c0f71391181ad', 'request_id': 'req-ff26d1a1-490d-4597-94e3-260a995498d3'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:05.507604 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] The token cache is being invalidate because project 96e5ff9480af46f5861c0f71391181ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:05.507893 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:05.508562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-ff26d1a1-490d-4597-94e3-260a995498d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:05.511380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1296/2559] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:05 2022] DELETE /identity/v3/projects/96e5ff9480af46f5861c0f71391181ad => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:05.514859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.515379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.515896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.533414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:05.534777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:05.593616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1264/2560] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:05.601457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.601736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.602015 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.620711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:05.621938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:05.630828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1297/2561] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:05.635050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.644982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12307941-79d7-49dc-9a1d-f9ddd9c7b6ef None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.649575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.650224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.650511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.650791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.651578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:05.651893 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.653545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.665641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1265/2562] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:43:05.669619 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.679054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560348-65f6-45c7-894b-627d5b5d775e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.683865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.684581 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.691192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.691192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.691192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.691192 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.766530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1298/2563] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:05 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:05.778439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.789624 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44b41-3606-4b5f-9e8b-5da11590c5d7 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.844229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.844921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.845205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.845480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.846693 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.848700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.918245 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1266/2564] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:05 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:05.922344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.933107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce007d-405a-4b58-aba9-8ef9bac55050 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.937816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.939252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.939252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.939252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.939871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.941461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.951646 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1299/2565] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:05.955519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.965529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be4f5c-c9a8-4335-9bad-93f68cb56042 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:05.970658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:05.971879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:05.972171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:05.972452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:05.973216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:05.974848 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f1ee4-0d4a-451a-8836-7b325e004447 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:05.984673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1267/2566] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:05.989022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:05.998629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1929-af83-4c72-8dd7-deef46dee959 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.003226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.004111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.004391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.004662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] PATH_INFO: `/v3/projects/3f374c7eeb764864980aee2cda9db90c/users/f358f4c02f554621b737305043026bdd/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.018361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f374c7eeb764864980aee2cda9db90c, user_id=f358f4c02f554621b737305043026bdd, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.021013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.107162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1300/2567] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:05 2022] PUT /identity/v3/projects/3f374c7eeb764864980aee2cda9db90c/users/f358f4c02f554621b737305043026bdd/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:06.118446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.118794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.119077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.145337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] MFA Rules not processed for user `f358f4c02f554621b737305043026bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:06.146533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:06.207604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1268/2568] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:06.211956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.271135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cb07b-6b58-473b-8a60-bf269ec44407 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.275835 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.276601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.276886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.277162 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.277854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.279790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.406861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1301/2569] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:06 2022] POST /identity/v3/projects => generated 401 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:06.411844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.424512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474c96-0dd2-487e-b790-5ddd0a0be54f None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.486246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.486905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.487663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.487954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.488749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.490741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.584462 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1269/2570] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:06 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:06.588412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.598857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac7544-b542-4f35-8983-7857ec500972 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.603809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.604628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.604976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.605337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.606124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.607739 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.617883 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1302/2571] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:06.622022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.632375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a249-93a6-433a-8873-3cb4559be447 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.637188 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.638080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.638375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.638660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] PATH_INFO: `/v3/projects/76dfef25d3c048beaf9bebc602941029/users/5d07cf3ec4a94325a886d17343882d8d/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.654329 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dfef25d3c048beaf9bebc602941029, user_id=5d07cf3ec4a94325a886d17343882d8d, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.657060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.748428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1270/2572] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:06 2022] PUT /identity/v3/projects/76dfef25d3c048beaf9bebc602941029/users/5d07cf3ec4a94325a886d17343882d8d/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:06.752918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.763641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed739da-da45-4986-8d64-52898a499fc5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.832547 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.833223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.833511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.833791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.834519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.836136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e33aa2-7b19-4b18-81df-c80f034fb272 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.851351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1303/2573] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:06.853293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:06.863904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9e203-0363-48b5-8bb4-1f47c04567bb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:06.868775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:06.869655 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.869942 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.870221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] PATH_INFO: `/v3/projects/76dfef25d3c048beaf9bebc602941029/users/5d07cf3ec4a94325a886d17343882d8d/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.872216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dfef25d3c048beaf9bebc602941029, user_id=5d07cf3ec4a94325a886d17343882d8d, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:06.874823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:06.885715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1271/2574] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:06 2022] PUT /identity/v3/projects/76dfef25d3c048beaf9bebc602941029/users/5d07cf3ec4a94325a886d17343882d8d/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:06.904217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:06.904517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:06.904802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:06.932272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] MFA Rules not processed for user `5d07cf3ec4a94325a886d17343882d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:06.934597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:07.011569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1304/2575] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:07.021080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:07.023792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:07.087409 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac45a3-50a2-48e5-96b2-77efed936023 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:07.091163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:07.091931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:07.092217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:07.092495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:07.101563 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:07.103000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e50c65-7b0a-4466-b070-af3b6233d264 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:07.112943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1272/2576] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:07.301333 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:07.311081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27882a2c-2dac-4e85-93ff-ea625407f772 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:07.314932 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:07.315941 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:07.316225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:07.316514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:07.377323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:07.379124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:07.388423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1305/2577] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:07.504483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:07.504779 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:07.505055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:07.524054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:07.525296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:07.586913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1273/2578] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:43:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:07.599900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:07.601319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:07.676288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecae1c-a057-46bc-ba4c-7aa66030d52d service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:07.681620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:07.682278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:07.682568 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:07.682897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:07.692400 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:07.694183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:07.708364 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1306/2579] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:43:08.383082 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:08.384728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:08.457748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdad0f-e47f-43ae-bd4a-1b1d6017cddd None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:08.463573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:08.464461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:08.464888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:08.465242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:08.468056 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:08.557553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:08.559084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:08.571347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1274/2580] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:08.691078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:08.692675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:08.798576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94272c-be99-44e7-913d-6e266621c669 service swift] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:08.812690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:08.813875 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:08.814373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:08.814930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:08.821320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:08.844639 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:08.849467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfdfb3-17bc-43a7-a0a7-b6a15b637504 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:08.875987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1307/2581] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:12.771198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:12.791090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d724db-3057-4c77-9ece-7325ab032d72 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:12.802861 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:12.807891 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:12.808231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:12.808514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] PATH_INFO: `/v3/users/f358f4c02f554621b737305043026bdd` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:12.812079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f358f4c02f554621b737305043026bdd)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:12.822385 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:13.075273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f358f4c02f554621b737305043026bdd'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.082728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f358f4c02f554621b737305043026bdd'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.176446 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f358f4c02f554621b737305043026bdd'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.178830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f358f4c02f554621b737305043026bdd'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.178830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f358f4c02f554621b737305043026bdd'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.201640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1275/2582] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:12 2022] DELETE /identity/v3/users/f358f4c02f554621b737305043026bdd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:13.206198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:13.207044 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:13.207506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:13.226006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:13.227240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:13.295347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1308/2583] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:13.305744 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:13.307360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:13.369103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4df1e2-3742-4d42-8c6b-00cb09253b37 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:13.373418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:13.374084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:13.374371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:13.374651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:13.387476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:13.389866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:13.402208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1276/2584] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:13.493600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:13.495406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:13.511259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98b03-92cb-4af2-8757-4aef44aacc58 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:13.522368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:13.522368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:13.522641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:13.523111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] PATH_INFO: `/v3/users/d4d9ee91364a45d8b423814654f2acc5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:13.524523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d9ee91364a45d8b423814654f2acc5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:13.528322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:13.703575 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d9ee91364a45d8b423814654f2acc5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.714385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d9ee91364a45d8b423814654f2acc5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.770897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d9ee91364a45d8b423814654f2acc5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.771591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d9ee91364a45d8b423814654f2acc5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.772231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d9ee91364a45d8b423814654f2acc5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:13.792063 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1309/2585] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:13 2022] DELETE /identity/v3/users/d4d9ee91364a45d8b423814654f2acc5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:13.862509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:13.865141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:13.894552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef163-1acd-4685-b9b8-120b19b6970e service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:13.985570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:13.986617 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:13.986910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:13.987191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] PATH_INFO: `/v3/projects/3f374c7eeb764864980aee2cda9db90c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:13.988481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f374c7eeb764864980aee2cda9db90c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:13.990695 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:14.053800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:14.055373 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:14.085014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fac72-cbad-4ad1-b951-3e4389956300 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:14.116632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f374c7eeb764864980aee2cda9db90c', 'request_id': 'req-0225a55e-b02b-454a-b1d3-310d2b2c79e2'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.126141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f374c7eeb764864980aee2cda9db90c', 'request_id': 'req-0225a55e-b02b-454a-b1d3-310d2b2c79e2'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.134593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f374c7eeb764864980aee2cda9db90c', 'request_id': 'req-0225a55e-b02b-454a-b1d3-310d2b2c79e2'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.199420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:14.200224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.200509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.200785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] PATH_INFO: `/v3/projects/39ba98058ea84295b1cce52d3e792a29` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.202992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ba98058ea84295b1cce52d3e792a29)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:14.204952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:14.206983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] The token cache is being invalidate because project 3f374c7eeb764864980aee2cda9db90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:14.207281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.207960 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.209553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1277/2586] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:13 2022] DELETE /identity/v3/projects/3f374c7eeb764864980aee2cda9db90c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:14.213430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:14.214979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:14.229538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225a55e-b02b-454a-b1d3-310d2b2c79e2 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:14.238620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:14.239615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.239896 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.240219 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] PATH_INFO: `/v3/users/5d07cf3ec4a94325a886d17343882d8d` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.241799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d07cf3ec4a94325a886d17343882d8d)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:14.244001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:14.333248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ba98058ea84295b1cce52d3e792a29', 'request_id': 'req-0c541b7c-b2df-4c90-aee6-ad547de96692'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.340115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ba98058ea84295b1cce52d3e792a29', 'request_id': 'req-0c541b7c-b2df-4c90-aee6-ad547de96692'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.346585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ba98058ea84295b1cce52d3e792a29', 'request_id': 'req-0c541b7c-b2df-4c90-aee6-ad547de96692'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.438650 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d07cf3ec4a94325a886d17343882d8d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.440434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] The token cache is being invalidate because project 39ba98058ea84295b1cce52d3e792a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:14.441067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.442438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-0c541b7c-b2df-4c90-aee6-ad547de96692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.444273 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1310/2587] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:14 2022] DELETE /identity/v3/projects/39ba98058ea84295b1cce52d3e792a29 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:14.453037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d07cf3ec4a94325a886d17343882d8d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.461064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147380f-2aae-4e41-a3f6-b67681eaa156 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.461453 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147380f-2aae-4e41-a3f6-b67681eaa156 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.461616 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147380f-2aae-4e41-a3f6-b67681eaa156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.488009 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8147380f-2aae-4e41-a3f6-b67681eaa156 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:14.489416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8147380f-2aae-4e41-a3f6-b67681eaa156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:14.562743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1311/2588] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:14.572681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.573116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.573423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.594319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:14.595737 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:14.604093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1312/2589] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:14.609272 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:14.619131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef552da4-c3e5-4609-bde7-9a40665f1e92 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:14.623850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:14.624477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.624795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.625105 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.625808 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:14.626157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:14.628692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:14.640733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1313/2590] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:43:14.645915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:14.655811 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1075c02-4de9-446a-8b4b-aca0640460ec admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:14.680201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:14.680201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:14.680201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:14.680201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:14.680648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:14.680648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:14.742523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d07cf3ec4a94325a886d17343882d8d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.743236 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d07cf3ec4a94325a886d17343882d8d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.743987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d07cf3ec4a94325a886d17343882d8d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:14.764009 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1278/2591] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:14 2022] DELETE /identity/v3/users/5d07cf3ec4a94325a886d17343882d8d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:14.995726 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1314/2592] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:14 2022] POST /identity/v3/projects => generated 387 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:15.000688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.002176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.074369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfa4c0-8247-4bbd-80d9-c8a31764c95d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.137074 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.137854 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.138203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.138541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.139346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.141327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.269986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1279/2593] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:14 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:15.274202 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.290926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b8c6-833e-47c5-9013-f9636fa29833 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.295854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.299675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.299675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.299675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.299675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.299675 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.313656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1315/2594] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:15.318217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.341624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.345604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29af35-7e85-4646-b7f1-79f3f056b598 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.349416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.352666 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.353346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.353634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.353915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.354646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.356360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.369716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1280/2595] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:15.373722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.385806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861bc9d-3df8-4547-b435-037c6b521caf admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.396438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563791b-987d-473d-9e37-1d7fc11280bb admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.400428 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.403268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.404652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.405572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] PATH_INFO: `/v3/projects/76dfef25d3c048beaf9bebc602941029` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.407772 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dfef25d3c048beaf9bebc602941029)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.413083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.414791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.415933 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.417312 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.417792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] PATH_INFO: `/v3/projects/42c9c282e25443dab874f936ec49750c/users/94f6928f94b74821a3a808a4fe4b397a/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.468393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c9c282e25443dab874f936ec49750c, user_id=94f6928f94b74821a3a808a4fe4b397a, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.472878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fad7e-a54c-4274-9194-4baddcf6a97c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.554711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1281/2596] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:15 2022] PUT /identity/v3/projects/42c9c282e25443dab874f936ec49750c/users/94f6928f94b74821a3a808a4fe4b397a/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:15.565353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.567591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.567591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.600636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dfef25d3c048beaf9bebc602941029', 'request_id': 'req-168520e5-1d6b-4464-ae41-d821db5e9b81'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:15.609800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dfef25d3c048beaf9bebc602941029', 'request_id': 'req-168520e5-1d6b-4464-ae41-d821db5e9b81'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:15.617252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dfef25d3c048beaf9bebc602941029', 'request_id': 'req-168520e5-1d6b-4464-ae41-d821db5e9b81'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:15.617718 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] MFA Rules not processed for user `94f6928f94b74821a3a808a4fe4b397a`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:15.624271 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.680967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] The token cache is being invalidate because project 76dfef25d3c048beaf9bebc602941029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:15.681414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:15.683270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-168520e5-1d6b-4464-ae41-d821db5e9b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:15.685559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1316/2597] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:15 2022] DELETE /identity/v3/projects/76dfef25d3c048beaf9bebc602941029 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:15.691798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55b64-d680-4303-a2fb-bb6a8a91fc34 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.692233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55b64-d680-4303-a2fb-bb6a8a91fc34 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.692613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55b64-d680-4303-a2fb-bb6a8a91fc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.707626 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1282/2598] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:15.711967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.713553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.715271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-cbb55b64-d680-4303-a2fb-bb6a8a91fc34 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:15.716600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cbb55b64-d680-4303-a2fb-bb6a8a91fc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.785803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27214fb8-8b3f-43d4-ab77-d0f58398a159 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.791492 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.792172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.792465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.792849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.793432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.795368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.822572 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1317/2599] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:15.830633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.830922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.835399 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.862232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:15.863494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:15.875586 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1318/2600] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:15.882724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.891169 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1283/2601] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:15.892185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d27440-e33b-4cf9-9ace-a738c3cf07b6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.894943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.952292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.953130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.953430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.953710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.956183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:15.956183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.956806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.969277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1319/2602] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:43:15.976111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:15.980808 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f86fb-ad03-4251-ba7b-0d7f42449b01 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.986189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.987928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.988226 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d39b6-d84e-4853-b7c9-c12c3e5aa96d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:15.988345 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.988691 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.989573 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:15.992558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:15.994320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:15.995341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:15.997390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:15.997847 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:15.998802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.003676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.104052 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1284/2603] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:16.108548 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.120051 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eeb59a-bfd0-4395-a158-df083a447136 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.127237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1320/2604] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:15 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:16.131066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.131066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.131066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.131066 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.131455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.132494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.133164 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.148479 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1285/2605] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:16.152064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.163980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587df57-d075-4e31-8d10-8fd7871ce25f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.222819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03018cb-92d9-42c6-bd05-8b3833969327 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.228321 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.229010 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.229294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.229573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.230266 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.232243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.237871 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.238984 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.239506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.240045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] PATH_INFO: `/v3/projects/da65ee71d92c4d02a66efc58113c7331/users/2e73a94b953b4d67afc2e31c564260c5/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.261869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da65ee71d92c4d02a66efc58113c7331, user_id=2e73a94b953b4d67afc2e31c564260c5, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.265189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.337099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1321/2606] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:16 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:16.341536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.349165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1286/2607] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:16 2022] PUT /identity/v3/projects/da65ee71d92c4d02a66efc58113c7331/users/2e73a94b953b4d67afc2e31c564260c5/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:16.352992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.353688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf16db0-48ab-4876-8817-2116593aee8e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.421585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a2526-fc81-4f5d-9aff-6f9ff13d308a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.424804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.426064 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.426852 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.427072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.427788 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.427915 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.428826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.429252 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.430095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.430280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.431934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.432253 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.443347 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1322/2608] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:16.449063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1287/2609] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:16.455592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.457226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.469104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520bc5-8663-43f2-ac7f-fcdf0fccd0a1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.469293 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c5a9-1ec1-408c-98d2-b670d8015adf admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.474669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.475377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.475663 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.476006 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.476743 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.478043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.478477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.479318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.479773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.480059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] PATH_INFO: `/v3/projects/da65ee71d92c4d02a66efc58113c7331/users/2e73a94b953b4d67afc2e31c564260c5/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.482059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=da65ee71d92c4d02a66efc58113c7331, user_id=2e73a94b953b4d67afc2e31c564260c5, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.485213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020464-e72e-41d6-8c17-82a1fa0c01ce admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.491718 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1323/2610] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:16.495613 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.506377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cbbf6-bedd-439c-a54e-c22a9ae814e3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.507688 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1288/2611] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:16 2022] PUT /identity/v3/projects/da65ee71d92c4d02a66efc58113c7331/users/2e73a94b953b4d67afc2e31c564260c5/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:16.519044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.519375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.519665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.553708 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] MFA Rules not processed for user `2e73a94b953b4d67afc2e31c564260c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:16.555205 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:16.614216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.615270 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.615715 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.616120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] PATH_INFO: `/v3/projects/8fbaf298b9674b85b243addfb4123c48/users/de11619d296943c0acc861426f06fab8/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.637248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fbaf298b9674b85b243addfb4123c48, user_id=de11619d296943c0acc861426f06fab8, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.645748 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1289/2612] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:16.645953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370846d1-ac3d-4aa1-a195-ed4f6dab4ce0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.652346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.654029 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:16.760325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1324/2613] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:16 2022] PUT /identity/v3/projects/8fbaf298b9674b85b243addfb4123c48/users/de11619d296943c0acc861426f06fab8/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:16.761467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe0970-7a4b-4a46-964f-f413bd04ab8e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.766030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.766330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.766687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.787408 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:16.793896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:16.829193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.830675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.832122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.832422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:16.876727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1325/2614] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:16.887633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:16.889283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:16.921982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:16.923629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:16.935338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1290/2615] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:16.975231 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e191-39e9-47b7-bafd-f6923873fcf6 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:16.980987 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:16.981596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:16.981884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:16.982166 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:17.001023 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:17.003558 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde464-a90a-4d91-b2b5-f5bc753d4df5 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:17.017471 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1326/2616] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:17.092959 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:17.104796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81bb6-6382-4dcb-b109-5235fd5c8440 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:17.110422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:17.111472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:17.111851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:17.112417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] PATH_INFO: `/v3/users/94f6928f94b74821a3a808a4fe4b397a` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:17.113948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f6928f94b74821a3a808a4fe4b397a)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:17.115985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:17.290208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f6928f94b74821a3a808a4fe4b397a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:17.300517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f6928f94b74821a3a808a4fe4b397a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:17.339025 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f6928f94b74821a3a808a4fe4b397a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:17.340372 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f6928f94b74821a3a808a4fe4b397a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:17.341328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f6928f94b74821a3a808a4fe4b397a'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:17.378716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1291/2617] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:17 2022] DELETE /identity/v3/users/94f6928f94b74821a3a808a4fe4b397a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:17.381337 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:17.381814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:17.381899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:17.407394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:17.409219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:17.490882 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1327/2618] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:17.501578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:17.511019 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:17.606076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ada7-1715-4c54-9ba7-b94ea1fe1832 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:17.610969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:17.611201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:17.612077 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:17.612361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:17.623860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:17.625995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459a56-bc4a-4490-96fe-c2b9fcf4bed1 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:17.642379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1292/2619] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:18.486727 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:18.488235 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:18.500169 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e152f8-d99c-4543-8a94-b1e668f5ddf0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:18.505816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:18.507281 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:18.507825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:18.508294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] PATH_INFO: `/v3/projects/42c9c282e25443dab874f936ec49750c` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:18.509868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c9c282e25443dab874f936ec49750c)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:18.512118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:18.662071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c9c282e25443dab874f936ec49750c', 'request_id': 'req-2ea87a53-92cd-4784-8e26-795bdae5543e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:18.673008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c9c282e25443dab874f936ec49750c', 'request_id': 'req-2ea87a53-92cd-4784-8e26-795bdae5543e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:18.686850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c9c282e25443dab874f936ec49750c', 'request_id': 'req-2ea87a53-92cd-4784-8e26-795bdae5543e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:18.697658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:18.698659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:18.699109 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:18.755305 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] MFA Rules not processed for user `de11619d296943c0acc861426f06fab8`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:18.757163 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:18.769596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] The token cache is being invalidate because project 42c9c282e25443dab874f936ec49750c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:18.770046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:18.771775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:18.774429 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1328/2620] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:18 2022] DELETE /identity/v3/projects/42c9c282e25443dab874f936ec49750c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:18.780110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:18.784719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:18.888771 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea87a53-92cd-4784-8e26-795bdae5543e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:18.894193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1293/2621] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:18.894602 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:18.900799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:18.901374 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:18.901850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] PATH_INFO: `/v3/users/2e73a94b953b4d67afc2e31c564260c5` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:18.903502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e73a94b953b4d67afc2e31c564260c5)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:18.906039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:18.907203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:18.910600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:18.974823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdbc9d-3013-4b33-b130-5f443e43ddc5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:18.981934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:18.982904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:18.983570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:18.984076 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:18.996382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:18.998079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:19.012553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1294/2622] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:19.090336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e73a94b953b4d67afc2e31c564260c5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.100486 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e73a94b953b4d67afc2e31c564260c5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.170500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e73a94b953b4d67afc2e31c564260c5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.171490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e73a94b953b4d67afc2e31c564260c5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.172452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-005974c2-0dba-47f1-b826-39203c4d7318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e73a94b953b4d67afc2e31c564260c5'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.194719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1329/2623] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:18 2022] DELETE /identity/v3/users/2e73a94b953b4d67afc2e31c564260c5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:19.635790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:19.647940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb63ac-2436-4d88-aae2-5b4363b4b652 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:19.707720 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:19.708614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:19.708899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:19.709572 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] PATH_INFO: `/v3/projects/da65ee71d92c4d02a66efc58113c7331` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:19.710469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da65ee71d92c4d02a66efc58113c7331)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:19.712559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:19.852576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da65ee71d92c4d02a66efc58113c7331', 'request_id': 'req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.858734 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da65ee71d92c4d02a66efc58113c7331', 'request_id': 'req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.864149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da65ee71d92c4d02a66efc58113c7331', 'request_id': 'req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.941760 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] The token cache is being invalidate because project da65ee71d92c4d02a66efc58113c7331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:19.941950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.943273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-d5ac7d63-ed3a-4a9f-9a53-da0fd239272e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:19.946315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1295/2624] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:19 2022] DELETE /identity/v3/projects/da65ee71d92c4d02a66efc58113c7331 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:19.951131 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:19.951587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:19.951587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:19.975923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:19.977523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:20.044556 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1330/2625] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:20.052244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.052535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.052811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.074675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:20.074675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:20.082486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1296/2626] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:20.086812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.096440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9291cf-8f55-4c58-8293-5c4cd099685f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.101134 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.101791 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.102076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.102362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.103078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:20.103456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.105061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.116315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1331/2627] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:43:20.120606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.130192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fec045-3bb5-4831-8f1e-dc4420608b84 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.134934 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.135612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.135898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.136171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.136858 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.138737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.223640 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1297/2628] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:20.227719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.237730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8b129-f5eb-4a42-9c65-6cb28f778e5b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.296165 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.296860 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.297152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.297431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.298309 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.300559 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.405379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1332/2629] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/users => generated 304 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:20.409834 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.420039 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc000c80-030a-442e-8909-3cae234c2520 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.425452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.426149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.426435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.426712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.427483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.429086 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.443202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1298/2630] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:20.444809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.457328 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe38ec-bd7a-40e6-8ed2-c16f77c77247 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.462467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.463197 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.469661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.469661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.469661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.469661 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fe442-5e4c-4a0e-b41f-ccf2f1f729bd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.476113 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1333/2631] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:20.480285 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.490644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949dd40-e4ca-4cf1-936d-8f3cf722cf1a admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.495386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.496259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.496546 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.498333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] PATH_INFO: `/v3/projects/fea4171f6a474b61ae078cf1e870ad24/users/f2e07192af77475d8d50428fb6af90fa/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.511589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea4171f6a474b61ae078cf1e870ad24, user_id=f2e07192af77475d8d50428fb6af90fa, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.514234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.576595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1299/2632] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:20 2022] PUT /identity/v3/projects/fea4171f6a474b61ae078cf1e870ad24/users/f2e07192af77475d8d50428fb6af90fa/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:20.586911 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59240345-511a-4f35-9c67-82cb2780294e None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.587210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59240345-511a-4f35-9c67-82cb2780294e None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.587525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59240345-511a-4f35-9c67-82cb2780294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.613871 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-59240345-511a-4f35-9c67-82cb2780294e None None] MFA Rules not processed for user `f2e07192af77475d8d50428fb6af90fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:20.615168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-59240345-511a-4f35-9c67-82cb2780294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:20.684123 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1334/2633] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:20.688388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.751930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b400c-b90b-4cd1-b8dd-bf17cf224d89 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.756652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.757311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.762272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.762272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.762272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.762272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce50e9b-51af-4069-8f94-f9a90b4db884 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:20.906022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1300/2634] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/projects => generated 407 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:20.910414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59240345-511a-4f35-9c67-82cb2780294e None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:20.928445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59240345-511a-4f35-9c67-82cb2780294e None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:20.937264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.937735 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.938095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.966295 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] MFA Rules not processed for user `de11619d296943c0acc861426f06fab8`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:20.967601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:20.987172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:20.991524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:20.991524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:20.991524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:20.991524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:20.991524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.034369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1301/2635] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:21.184028 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1335/2636] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:20 2022] POST /identity/v3/users => generated 310 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:21.193679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.205677 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350c0b-3cb6-4510-b8c0-ae174fe31536 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.210420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.211092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.211414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.211701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.212451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.214057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.224138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1302/2637] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:21.228635 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.240216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583dd80-d789-4fbf-b2d9-b7d45c78635c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.245323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.246498 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.247338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.247338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] PATH_INFO: `/v3/projects/8e5ceb38560745ef88e115c98e018e5a/users/7d71f275b5f34e46abf4ec453476a0e3/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.264571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5ceb38560745ef88e115c98e018e5a, user_id=7d71f275b5f34e46abf4ec453476a0e3, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.267206 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.394476 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1336/2638] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:21 2022] PUT /identity/v3/projects/8e5ceb38560745ef88e115c98e018e5a/users/7d71f275b5f34e46abf4ec453476a0e3/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:21.398769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.404752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.406446 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:21.409112 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41275-7ba5-4ac8-b8df-5c33dfc1370d admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.465864 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527586cc-dea7-420e-b5de-10546d4a34e7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.469595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.470244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.470543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.471413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.473228 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:21.479461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.480182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.480445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.480703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.481434 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.483044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.483153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.484544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae46143-c88a-4e27-b02f-f687a4487bd8 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.494416 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1303/2640] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:21.495378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1337/2640] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:21.498428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.508189 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b5b3f-3c37-40ef-bee7-528df81974f4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.512833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.513717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.514011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.514291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] PATH_INFO: `/v3/projects/8e5ceb38560745ef88e115c98e018e5a/users/7d71f275b5f34e46abf4ec453476a0e3/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.516357 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5ceb38560745ef88e115c98e018e5a, user_id=7d71f275b5f34e46abf4ec453476a0e3, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.519015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.529300 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1304/2641] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:21 2022] PUT /identity/v3/projects/8e5ceb38560745ef88e115c98e018e5a/users/7d71f275b5f34e46abf4ec453476a0e3/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:21.541367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.541660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.541940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.568306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] MFA Rules not processed for user `7d71f275b5f34e46abf4ec453476a0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:21.569735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:21.640285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1338/2642] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:21.649843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.651682 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:21.710075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f8c57-3fac-422f-9c88-152acf6ea0f0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:21.713868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:21.714515 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:21.714797 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:21.715067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:21.724812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:21.726239 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:21.735439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1305/2643] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:21.977951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:21.979489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:22.050472 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9758b-0cab-4b24-bec1-2f103f331f7a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:22.055855 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:22.059356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:22.059356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:22.059356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:22.059356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:22.076887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:22.077923 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:22.078482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:22.086732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fbfea-2b33-42b9-aafe-6933e8152063 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:22.088989 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1339/2644] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:22.090415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:22.091054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:22.091379 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:22.091660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:22.147193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:22.148707 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:22.158802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1306/2645] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:27.997076 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:28.050367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e290226-9cc1-4874-99bc-4a24f978d0f6 service placement] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:28.054039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:28.054685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:28.054967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:28.055242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:28.057212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:28.076620 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:28.078088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8932f-ebe8-4183-a8d7-70537c4e9aac service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:28.086569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1340/2646] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:32.233926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:32.297339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accab60-cf5b-4e0e-9dc6-d219f1e8f98e service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:32.302616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:32.304574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:32.304574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:32.304574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] PATH_INFO: `/v3/users/f2e07192af77475d8d50428fb6af90fa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:32.305770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e07192af77475d8d50428fb6af90fa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:32.307758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:32.418024 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:32.418562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:32.418669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:32.441605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:32.442812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:32.500014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1341/2647] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:32.521873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:32.523320 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:32.554908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e07192af77475d8d50428fb6af90fa'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:32.561490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e07192af77475d8d50428fb6af90fa'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:32.591509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528756c-7ea3-4c58-8832-93859e4857f4 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:32.597149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:32.597826 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:32.598111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:32.598387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:32.606435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:32.608099 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d5cf9-a136-4abe-adf6-cc030c3dd338 service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:32.616029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1342/2648] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:43:32.621048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e07192af77475d8d50428fb6af90fa'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:32.621827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e07192af77475d8d50428fb6af90fa'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:32.622470 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e07192af77475d8d50428fb6af90fa'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:32.643159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1307/2649] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:32 2022] DELETE /identity/v3/users/f2e07192af77475d8d50428fb6af90fa => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:32.647652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:32.647940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:32.648212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:32.665181 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:32.666369 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:32.724027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1343/2650] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:32.733818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:32.735278 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:32.807530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e66201-fd8c-41c1-983d-4806ce000574 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:32.813509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:32.814264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:32.815818 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:32.816196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:32.833826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:32.836349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:32.855096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1308/2651] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:33.552965 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:33.557132 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:33.598889 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2570c-8147-4a02-9a16-6e2adc7f99fd None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:33.607533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:33.608420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:33.608913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:33.609299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] PATH_INFO: `/v3/projects/fea4171f6a474b61ae078cf1e870ad24` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:33.611507 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea4171f6a474b61ae078cf1e870ad24)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:33.614978 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:33.780030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea4171f6a474b61ae078cf1e870ad24', 'request_id': 'req-4736079e-b149-4c82-8f53-4e62bcfd463a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:33.788210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea4171f6a474b61ae078cf1e870ad24', 'request_id': 'req-4736079e-b149-4c82-8f53-4e62bcfd463a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:33.794747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea4171f6a474b61ae078cf1e870ad24', 'request_id': 'req-4736079e-b149-4c82-8f53-4e62bcfd463a'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:33.873488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] The token cache is being invalidate because project fea4171f6a474b61ae078cf1e870ad24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:33.873789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:33.875734 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:33.878403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1344/2652] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:33 2022] DELETE /identity/v3/projects/fea4171f6a474b61ae078cf1e870ad24 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:33.882869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:33.894383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547e350-3adf-4d56-9ce8-2dbdd1d21810 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:33.962580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:33.963703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:33.964102 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:33.964483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] PATH_INFO: `/v3/users/7d71f275b5f34e46abf4ec453476a0e3` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:33.966022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d71f275b5f34e46abf4ec453476a0e3)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:33.968268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:34.166504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d71f275b5f34e46abf4ec453476a0e3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:34.177856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d71f275b5f34e46abf4ec453476a0e3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:34.245319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d71f275b5f34e46abf4ec453476a0e3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:34.246746 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d71f275b5f34e46abf4ec453476a0e3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:34.249002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cca530c9-0940-44e0-80a1-4bfa090b8bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d71f275b5f34e46abf4ec453476a0e3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:34.293581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1309/2653] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:33 2022] DELETE /identity/v3/users/7d71f275b5f34e46abf4ec453476a0e3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:34.927034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:34.928719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:34.943395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736079e-b149-4c82-8f53-4e62bcfd463a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.012862 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.013753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.014038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.014316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] PATH_INFO: `/v3/projects/8e5ceb38560745ef88e115c98e018e5a` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.015538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5ceb38560745ef88e115c98e018e5a)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.017470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.119414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5ceb38560745ef88e115c98e018e5a', 'request_id': 'req-68969c02-5bdb-4371-872b-e2bf32e81ce0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:35.125887 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5ceb38560745ef88e115c98e018e5a', 'request_id': 'req-68969c02-5bdb-4371-872b-e2bf32e81ce0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:35.131680 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5ceb38560745ef88e115c98e018e5a', 'request_id': 'req-68969c02-5bdb-4371-872b-e2bf32e81ce0'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:35.224370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] The token cache is being invalidate because project 8e5ceb38560745ef88e115c98e018e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:35.224611 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:35.225247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-68969c02-5bdb-4371-872b-e2bf32e81ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:35.226894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1345/2654] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:34 2022] DELETE /identity/v3/projects/8e5ceb38560745ef88e115c98e018e5a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:35.232710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.233270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.233270 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.252211 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:35.255598 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:35.327916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.328215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.328494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.329863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1310/2655] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:35.350362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:35.351677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:35.360645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1346/2656] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:35.365034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.375977 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c10f2a-f621-43ed-9543-0dad21c7606e None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.380845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.381511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.381790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.382148 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.382930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:35.383242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.384883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.397837 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1311/2657] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:43:35.402398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.412594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db527a27-d6c1-4874-a446-7687e472cb53 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.417375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.418029 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.418316 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.418597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.419356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.421241 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.522899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1347/2658] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:35 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:35.527079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.537922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a479eef-dc21-4b6a-b8cb-08862c6992f8 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.617319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.618083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.618342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.618615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.619351 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.621465 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.729413 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1312/2659] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:35 2022] POST /identity/v3/users => generated 280 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:35.730342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.741669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb9aa-3fbf-4dec-9a59-cbc9595ec33f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.746834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.747696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.748040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.748388 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.749243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.750969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.767107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.768585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1348/2660] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:35.777911 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac31c4-a509-4f34-bf4b-85f252db088e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.782529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.783207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.783794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.784075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.784812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.786436 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbc0f-2d82-47c3-930c-30cc24fdc063 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.796757 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1313/2661] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:35.801049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:35.811794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2f79-1d0d-4f0b-84af-ce7ac59efd43 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:35.817733 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:35.819968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.819968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.819968 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] PATH_INFO: `/v3/projects/6b58335c06dc459ca7145585d862cd43/users/37252078cd774b14ae893aebd91d2456/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.852090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b58335c06dc459ca7145585d862cd43, user_id=37252078cd774b14ae893aebd91d2456, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:35.855037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:35.925193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1349/2662] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:35 2022] PUT /identity/v3/projects/6b58335c06dc459ca7145585d862cd43/users/37252078cd774b14ae893aebd91d2456/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:35.935813 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:35.936425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:35.936945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:35.979215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] MFA Rules not processed for user `37252078cd774b14ae893aebd91d2456`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:35.981587 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:36.096268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1314/2663] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:36.124326 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:36.126121 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:36.208894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441e037-859d-470e-92c0-7d20ef021f37 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:36.212306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:36.213146 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:36.213491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:36.213841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:36.224335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:36.225913 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a484f32-c2bc-4147-842e-52f77067b823 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:36.235551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1350/2664] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:36.251843 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:36.337387 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8afde-bef6-4269-8bd4-ec0ea7324cec None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:36.343000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:36.344078 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:36.344607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:36.345027 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] PATH_INFO: `/v3/users/37252078cd774b14ae893aebd91d2456` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:36.346315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37252078cd774b14ae893aebd91d2456)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:36.348571 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:36.518499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37252078cd774b14ae893aebd91d2456'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:36.526141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37252078cd774b14ae893aebd91d2456'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:36.621955 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37252078cd774b14ae893aebd91d2456'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:36.622774 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37252078cd774b14ae893aebd91d2456'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:36.623497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37252078cd774b14ae893aebd91d2456'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:36.653013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1315/2665] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:36 2022] DELETE /identity/v3/users/37252078cd774b14ae893aebd91d2456 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:36.657107 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:36.657617 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:36.657995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:36.681755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:36.683250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:36.784030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1351/2666] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:36.797147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:36.798668 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:36.880461 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93d4fa-f67a-4507-9cc2-d29b4ba3ca62 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:36.884054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:36.884700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:36.884985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:36.885261 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:36.900213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:36.901667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90600936-4af5-4d25-aa87-ff2c85f895a7 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:36.912069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1316/2667] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:37.363820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:37.365526 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:37.382863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f07e47-a547-4c98-b495-d960afcbc9b3 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:37.391605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:37.398172 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:37.398721 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:37.404538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] PATH_INFO: `/v3/projects/6b58335c06dc459ca7145585d862cd43` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:37.404538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b58335c06dc459ca7145585d862cd43)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:37.404538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:37.504702 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b58335c06dc459ca7145585d862cd43', 'request_id': 'req-71e63c74-775c-46e9-a5f7-90080ab0c1b1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:37.513912 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b58335c06dc459ca7145585d862cd43', 'request_id': 'req-71e63c74-775c-46e9-a5f7-90080ab0c1b1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:37.520001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b58335c06dc459ca7145585d862cd43', 'request_id': 'req-71e63c74-775c-46e9-a5f7-90080ab0c1b1'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:37.611465 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] The token cache is being invalidate because project 6b58335c06dc459ca7145585d862cd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:37.611789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:37.612413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-71e63c74-775c-46e9-a5f7-90080ab0c1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:37.614018 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1352/2668] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:37 2022] DELETE /identity/v3/projects/6b58335c06dc459ca7145585d862cd43 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:37.619432 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:37.620034 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:37.620198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:37.667991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:37.667991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:37.716532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1317/2669] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:37.724959 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:37.725261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:37.725544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:37.744435 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:37.745696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:37.753753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1353/2670] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:37.757985 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:37.768360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dcb73-897c-44aa-8f69-e3f6dcc6b3fc None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:37.773307 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:37.774007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:37.774324 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:37.774608 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:37.775591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:37.775906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:37.779161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:37.794343 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1318/2671] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:43:37.812969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:37.830922 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61880627-8c85-46e4-8da7-60b3a28ff915 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:37.848264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:37.849046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:37.849332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:37.849618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:37.850323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:37.852284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:37.990886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1354/2672] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:37 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:37.995002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.006318 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e616-7d2a-4fa0-9e3c-0892959d35de admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.066251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.067048 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.067377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.067799 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.068518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.070430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.182037 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1319/2673] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:37 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:38.185999 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.197510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc4707-0356-4144-930b-99c6f53a6bab admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.202551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.203254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.203562 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.203838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.204566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.206761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.222890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1355/2674] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:38.227065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.237314 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b39860-97ef-4dde-b74e-27d0f9ff6406 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.241856 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.242616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.242876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.243154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.243912 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.245567 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a2671-4a01-4de8-a7ef-3bbcea6d9784 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.256196 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1320/2675] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:38.260250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.270669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0389-d960-4c9a-81f5-ee26150a55d7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.275151 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.276036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.276317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.276588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] PATH_INFO: `/v3/projects/aacb0fa308dc4853a7d4f5e88321eaff/users/35d2f032b0b94415b5d8decd93b4767e/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.290844 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacb0fa308dc4853a7d4f5e88321eaff, user_id=35d2f032b0b94415b5d8decd93b4767e, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.293485 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.385261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1356/2676] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:38 2022] PUT /identity/v3/projects/aacb0fa308dc4853a7d4f5e88321eaff/users/35d2f032b0b94415b5d8decd93b4767e/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:38.395342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.395596 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.395922 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.423541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] MFA Rules not processed for user `35d2f032b0b94415b5d8decd93b4767e`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:38.425415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:38.491098 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1321/2677] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:38.495257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.571011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671322f-1309-4bac-81d7-d46ee11b00e7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.583543 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.584690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.585055 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.585416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.586204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.589259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.697953 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1357/2678] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:38 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:38.698566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.710250 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ffed-bc89-4c9c-8fbc-02bf0a7d6d97 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.808703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.809789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.810338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.810847 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.811930 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.815428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.907447 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1322/2679] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:38 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:43:38.911707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.925005 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7366d2-e4b6-4c18-8920-52ceeb026246 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.932850 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.933907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.934271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.934626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.935539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.943952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:38.951846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1358/2680] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:38.953690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:38.968844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf5eb1-2365-4afb-8971-a8fb30977ac4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:38.973542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:38.974566 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:38.974906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:38.975191 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] PATH_INFO: `/v3/projects/8ac484d189a34b468dd11cb5c89c706d/users/26839568fd8c4eda808f4acb56120901/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:38.991355 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac484d189a34b468dd11cb5c89c706d, user_id=26839568fd8c4eda808f4acb56120901, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:38.994217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:39.096716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1323/2681] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:38 2022] PUT /identity/v3/projects/8ac484d189a34b468dd11cb5c89c706d/users/26839568fd8c4eda808f4acb56120901/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:39.100631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:39.119153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6d70c-8593-4aec-a52a-d9a45dcb34dd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:39.182072 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:39.182755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:39.183046 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:39.183354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:39.184088 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:39.185778 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e554-ef4c-4e49-a761-251ed33a5150 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:39.198368 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1359/2682] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:39.205001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:39.219160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4348913-9793-4e1f-9aa9-66e0e9ea94ee admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:39.226787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:39.227731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:39.228021 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:39.228389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] PATH_INFO: `/v3/projects/8ac484d189a34b468dd11cb5c89c706d/users/26839568fd8c4eda808f4acb56120901/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:39.230781 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac484d189a34b468dd11cb5c89c706d, user_id=26839568fd8c4eda808f4acb56120901, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:39.233768 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:39.255011 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1324/2683] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:39 2022] PUT /identity/v3/projects/8ac484d189a34b468dd11cb5c89c706d/users/26839568fd8c4eda808f4acb56120901/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:39.274977 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:39.275279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:39.275633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:39.306315 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] MFA Rules not processed for user `26839568fd8c4eda808f4acb56120901`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:39.308517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:39.375751 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1360/2684] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:39.386394 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:39.388796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:39.453220 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853f7be-3103-46ae-8bb0-f16651af63a1 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:39.457157 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:39.457811 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:39.458091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:39.458364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:39.515428 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:39.516920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c1826-4d71-4660-94cb-0288fd73e0a7 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:39.526177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1325/2685] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:42.707625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:42.766530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309a81c-479b-475a-ac0e-c56f182e7f07 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:42.771092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:42.771975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:42.772260 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:42.772544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] PATH_INFO: `/v3/users/35d2f032b0b94415b5d8decd93b4767e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:42.773720 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d2f032b0b94415b5d8decd93b4767e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:42.775688 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:42.945385 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d2f032b0b94415b5d8decd93b4767e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:42.952128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d2f032b0b94415b5d8decd93b4767e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:42.992638 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d2f032b0b94415b5d8decd93b4767e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:42.993298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d2f032b0b94415b5d8decd93b4767e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:42.993943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d2f032b0b94415b5d8decd93b4767e'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.010732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1361/2686] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:42 2022] DELETE /identity/v3/users/35d2f032b0b94415b5d8decd93b4767e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:43.015141 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:43.015658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:43.015764 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:43.032494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:43.034510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:43.088679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1326/2687] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:43.098803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:43.100209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:43.154502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68592-a0eb-41ee-9038-65f1b40c28a5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:43.158925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:43.159600 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:43.159885 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:43.160159 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:43.168827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:43.170242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:43.179389 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1362/2688] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:43.573063 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:43.582916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:43.595776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a2dbd-9c60-45f9-9dd8-1473e3d4849c None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:43.601068 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:43.602035 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:43.602437 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:43.602817 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] PATH_INFO: `/v3/projects/aacb0fa308dc4853a7d4f5e88321eaff` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:43.604154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacb0fa308dc4853a7d4f5e88321eaff)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:43.611850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:43.794700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacb0fa308dc4853a7d4f5e88321eaff', 'request_id': 'req-386f3d46-a3a5-49eb-8042-306eae054a6c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.804053 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacb0fa308dc4853a7d4f5e88321eaff', 'request_id': 'req-386f3d46-a3a5-49eb-8042-306eae054a6c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.809833 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacb0fa308dc4853a7d4f5e88321eaff', 'request_id': 'req-386f3d46-a3a5-49eb-8042-306eae054a6c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.884532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] The token cache is being invalidate because project aacb0fa308dc4853a7d4f5e88321eaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:43.885564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.886509 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:43.888529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1327/2689] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:43 2022] DELETE /identity/v3/projects/aacb0fa308dc4853a7d4f5e88321eaff => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:43.892457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:43.912348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3d81c-ede7-42da-95b5-3c221ecec323 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:43.972991 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:43.973857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:43.974145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:43.974427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] PATH_INFO: `/v3/users/26839568fd8c4eda808f4acb56120901` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:43.975656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26839568fd8c4eda808f4acb56120901)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:43.977633 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:44.189842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26839568fd8c4eda808f4acb56120901'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.198342 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26839568fd8c4eda808f4acb56120901'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.262108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26839568fd8c4eda808f4acb56120901'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.262746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26839568fd8c4eda808f4acb56120901'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.263395 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-9ab4f6f8-50e8-435e-8343-1c0bcb537523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26839568fd8c4eda808f4acb56120901'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.281133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1363/2690] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:43:43 2022] DELETE /identity/v3/users/26839568fd8c4eda808f4acb56120901 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:44.691885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:44.693451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:44.707162 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3d46-a3a5-49eb-8042-306eae054a6c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:44.772303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:44.773398 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:44.773863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:44.774316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] PATH_INFO: `/v3/projects/8ac484d189a34b468dd11cb5c89c706d` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:44.775717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac484d189a34b468dd11cb5c89c706d)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:44.778046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:44.885083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac484d189a34b468dd11cb5c89c706d', 'request_id': 'req-c4360e06-b32f-406e-baf2-9b7e7b5e642f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.891500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac484d189a34b468dd11cb5c89c706d', 'request_id': 'req-c4360e06-b32f-406e-baf2-9b7e7b5e642f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.897584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac484d189a34b468dd11cb5c89c706d', 'request_id': 'req-c4360e06-b32f-406e-baf2-9b7e7b5e642f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.996986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] The token cache is being invalidate because project 8ac484d189a34b468dd11cb5c89c706d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:43:44.997342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:44.998316 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-c4360e06-b32f-406e-baf2-9b7e7b5e642f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:43:45.000634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1328/2691] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:43:44 2022] DELETE /identity/v3/projects/8ac484d189a34b468dd11cb5c89c706d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:43:45.006067 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.006745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.006745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.026062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:45.027504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.094234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1364/2692] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:45.105483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.105884 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.106231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.125426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:45.126665 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.135084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1329/2693] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:45.139415 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.149652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d11f83-15e2-436f-a2ca-96be211e4988 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.154569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.156032 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.156420 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.156763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.157557 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:43:45.158854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.160681 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.173108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1365/2694] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:43:45.177557 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.187001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35432-36ca-4d5b-85af-111fea8ff7bf None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.192124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.192662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.192939 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.193209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.193897 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.195806 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df254-3c57-48c3-8221-c7b0d8d0c471 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.301246 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1330/2695] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:45.302506 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.313053 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35c903-2a27-42d0-b83e-9af8b66e1d64 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.390063 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.390732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.391068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.391423 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.392108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.394014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.404183 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3204c-0342-409d-ab86-e2552e7c96a8 None None] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.404618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3204c-0342-409d-ab86-e2552e7c96a8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.404995 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3204c-0342-409d-ab86-e2552e7c96a8 None None] PATH_INFO: `/` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.406866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1331/2696] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:43:45.413233 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.413521 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.413862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.436281 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] MFA Rules not processed for user `3db3df5c19dd4331a2c85d3a10bcb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:45.438095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.494991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1332/2697] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:45.507797 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1366/2698] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:43:45.508841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.510209 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.511658 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.520591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f705-5074-4930-ae68-480f83ff6559 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.521300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9020fbf-b4b4-4e42-9b6b-56c1e2d07b08 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.524279 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.524919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.525206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.525482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.525974 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.526622 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.526909 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.527186 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.528054 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.529655 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.532583 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.535809 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.540344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1367/2699] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:43:45.543015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1333/2700] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:45.544075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.554242 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e7674-28e7-4cad-85cc-cf2df2be920b admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.564317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.564317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.564317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.564317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.564742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.564742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0676612-81d3-4f1e-af98-3a2ce868058f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.576924 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1368/2701] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:43:45.581251 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.599005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4db72-c875-42e0-8ca8-3f1493900d1b service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.600259 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.601050 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.601333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.601607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] PATH_INFO: `/v3/projects/e797b3310ab046cd9c688029ee8d8565/users/fb376ea04975450183eca36bead113da/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.618967 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e797b3310ab046cd9c688029ee8d8565, user_id=fb376ea04975450183eca36bead113da, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.623007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a46eb-47af-44b3-97ce-f781ee8b054e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.644927 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5199ed-2727-43c1-b7a4-6b072dcdb3aa None None] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.645213 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5199ed-2727-43c1-b7a4-6b072dcdb3aa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.645489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5199ed-2727-43c1-b7a4-6b072dcdb3aa None None] PATH_INFO: `/` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.647322 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1369/2702] 10.222.0.65 () {54 vars in 921 bytes} [Mon Feb 21 09:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:43:45.652722 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.656246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.656246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.672670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] MFA Rules not processed for user `e7eb5c189bbd41449e3478b7dfcb27fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:45.674451 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.716095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1334/2703] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:43:45 2022] PUT /identity/v3/projects/e797b3310ab046cd9c688029ee8d8565/users/fb376ea04975450183eca36bead113da/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:43:45.728443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.729342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.730350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.744846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1370/2704] 10.222.0.65 () {58 vars in 1018 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:45.757085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.761919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] MFA Rules not processed for user `fb376ea04975450183eca36bead113da`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:45.763539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.771098 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730082-5351-4842-9ec1-a12d12e8357f None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.823068 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.823779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.824062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.824350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.841454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1335/2705] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:43:45.855134 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:45.856533 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:45.898946 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.900430 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64244a-e83c-4d83-b670-5f001b4dce41 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.912687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1371/2706] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:45.923943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68ae4-60fd-492e-9213-b91dd7ddb6b3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:45.927700 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac705ffe7884b0db365621e8bd286cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:45.928337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:45.928680 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:45.928949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:45.938070 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:45.939576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:45.948504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1336/2707] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:43:47.581805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:47.582920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:47.583396 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:47.616549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:47.617749 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:47.678276 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1372/2708] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:47.691716 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:47.693269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:47.773390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec10db-99ba-4837-9bb7-909aab5d0362 service glance] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:47.778625 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:47.779265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:47.779575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:47.779849 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:47.788091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:47.789653 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430a48-e8a5-4b4a-a0ff-76a275d6727b service swift] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:47.797663 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1337/2709] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:43:49.869760 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:43:49.871282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:49.889491 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e3312-05ea-4efb-878e-5fdbc17fb888 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:43:49.895832 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:43:49.896597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:49.896894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:49.897367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:49.899793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:49.913595 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:43:49.915108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb35c8-bca8-40b9-ab8b-56a1d434e920 service nova] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:43:49.928524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1373/2710] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:43:51.119212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f72c-cb84-48f0-8ef1-f940d9216e0f None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:51.119727 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f72c-cb84-48f0-8ef1-f940d9216e0f None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:51.123130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f72c-cb84-48f0-8ef1-f940d9216e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:51.137172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-92b1f72c-cb84-48f0-8ef1-f940d9216e0f None None] MFA Rules not processed for user `de11619d296943c0acc861426f06fab8`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:51.138361 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-92b1f72c-cb84-48f0-8ef1-f940d9216e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:51.191908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1338/2711] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:43:56.982976 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:43:56.983567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:43:56.993898 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:43:57.002049 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] MFA Rules not processed for user `abb204e5377544b09ceb754b8a9bd072`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:43:57.003247 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:43:57.060881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1374/2712] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:43:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:20.300100 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:20.300616 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:20.300728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:20.319549 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:20.330926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:20.330926 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1339/2713] 10.222.0.65 () {58 vars in 1009 bytes} [Mon Feb 21 09:44:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:20.340353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:20.352692 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c233e-d089-42d0-bf23-3dab2fd2c716 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:20.357673 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:20.358332 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:20.358608 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:20.358885 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:20.367215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:20.368908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecfc23-288d-48fd-b749-207755fa6a15 service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:20.380630 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1375/2714] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:44:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:44:26.247490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:26.324931 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e7799-d10f-4499-8d70-d3d101386fc5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:26.329705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:26.330581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:26.330863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:26.331136 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] PATH_INFO: `/v3/users/fb376ea04975450183eca36bead113da` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:26.332499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb376ea04975450183eca36bead113da)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:26.334988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:26.546710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb376ea04975450183eca36bead113da'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:26.556869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb376ea04975450183eca36bead113da'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:26.626623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb376ea04975450183eca36bead113da'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:26.627410 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb376ea04975450183eca36bead113da'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:26.628244 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb376ea04975450183eca36bead113da'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:26.649528 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1340/2715] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:26 2022] DELETE /identity/v3/users/fb376ea04975450183eca36bead113da => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:26.654250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:26.654814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:26.654814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:26.683405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:26.683405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:26.746490 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1376/2716] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:26.756879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:26.758313 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:26.815216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e3d26-3ae3-47e5-8c08-4f882bd17e6b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:26.820181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:26.820910 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:26.821277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:26.821630 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:26.831227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:26.832992 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288e82-7120-4a01-9686-ac18b69096b7 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:26.844262 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1341/2717] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:27.337589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:27.339454 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:27.354626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1924f21-9d7b-49b2-9d76-162188742bc1 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:27.363255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:27.364676 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.365212 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.366901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] PATH_INFO: `/v3/projects/e797b3310ab046cd9c688029ee8d8565` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.368690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e797b3310ab046cd9c688029ee8d8565)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:27.381614 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:27.493335 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e797b3310ab046cd9c688029ee8d8565', 'request_id': 'req-8a085c8b-48fa-4d86-9db0-b86f64d8e969'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:27.500777 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e797b3310ab046cd9c688029ee8d8565', 'request_id': 'req-8a085c8b-48fa-4d86-9db0-b86f64d8e969'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:27.508115 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e797b3310ab046cd9c688029ee8d8565', 'request_id': 'req-8a085c8b-48fa-4d86-9db0-b86f64d8e969'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:27.599628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] The token cache is being invalidate because project e797b3310ab046cd9c688029ee8d8565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:27.599628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:27.599628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-8a085c8b-48fa-4d86-9db0-b86f64d8e969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:27.599628 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1377/2718] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:27 2022] DELETE /identity/v3/projects/e797b3310ab046cd9c688029ee8d8565 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:27.601778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.602601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.603125 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.622804 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:27.629241 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:27.696393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1342/2719] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:27.698634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.699148 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.699440 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.720000 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:27.721632 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:27.733745 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1378/2720] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:27.734773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:27.746304 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7b11c-1b4e-4eec-910d-d1120b03fd9b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:27.754620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:27.755330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.755770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.756660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.758545 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:44:27.758919 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:27.760737 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:27.778803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1343/2721] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:44:27.780171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:27.791201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450cea2-75f3-41a2-a08d-cf7cd4b67886 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:27.796427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:27.797090 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.797377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.797653 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.798348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:27.800504 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:27.892518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1379/2722] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:27 2022] POST /identity/v3/projects => generated 399 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:27.893356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:27.907149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a171b-ce6a-4ec7-a0c8-081a35eba347 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:27.969536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:27.970597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:27.970805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:27.971167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:27.971830 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:27.973780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:28.066779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:28.073203 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1344/2723] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:27 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:44:28.078462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3070b2-521b-4b6d-a0ef-f083843acca5 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:28.086403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:28.087079 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:28.087403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:28.087699 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:28.088452 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:28.090138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:28.101770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1380/2724] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:44:28.105948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:28.117106 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d9b0e-811d-4721-bc08-7c381db94cb9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:28.121862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:28.122527 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:28.122812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:28.123097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:28.123874 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:28.125520 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e72cb2-39a5-4864-9e19-07b0c05c181f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:28.139065 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1345/2725] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:28.143193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:28.154051 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5acd2-7ee3-4704-9383-bbaff40f2bb4 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:28.159097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:28.160294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:28.160580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:28.160858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] PATH_INFO: `/v3/projects/fd7f2080257142b8b49d889ef4d2720c/users/8e17a9b26c564fe3ad173068225de892/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:28.181377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7f2080257142b8b49d889ef4d2720c, user_id=8e17a9b26c564fe3ad173068225de892, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:28.184089 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:28.271585 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1381/2726] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:28 2022] PUT /identity/v3/projects/fd7f2080257142b8b49d889ef4d2720c/users/8e17a9b26c564fe3ad173068225de892/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:28.281733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:28.286810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:28.286810 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:28.319979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] MFA Rules not processed for user `8e17a9b26c564fe3ad173068225de892`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:28.321802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:28.398964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1346/2727] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:28.409775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:28.416066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:28.475876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062bc02-a11a-46eb-ac2b-d3cadec7860a admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:28.480334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:28.480997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:28.481287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:28.481563 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:28.493350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:28.494735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14f33e-1eff-4cda-aeb1-54a43b40c8a4 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:28.504730 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1382/2728] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:37.389087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:37.455415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a40edd-5706-4de2-8374-2fca417bc5c5 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:37.461392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:37.462360 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:37.462714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:37.463061 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] PATH_INFO: `/v3/users/8e17a9b26c564fe3ad173068225de892` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:37.464392 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e17a9b26c564fe3ad173068225de892)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:37.466328 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:37.621482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:37.621993 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:37.622224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:37.640648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] MFA Rules not processed for user `1914a3193cd74814b7344c15a1eb0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:37.641940 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:37.695511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e17a9b26c564fe3ad173068225de892'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:37.705415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e17a9b26c564fe3ad173068225de892'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:37.722371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1383/2729] 10.222.0.65 () {58 vars in 967 bytes} [Mon Feb 21 09:44:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:44:37.735652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:37.737176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:37.770928 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e17a9b26c564fe3ad173068225de892'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:37.772584 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e17a9b26c564fe3ad173068225de892'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:37.773639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50609174-5539-4f77-86d0-06824ef9d240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e17a9b26c564fe3ad173068225de892'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:37.792133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1347/2730] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:37 2022] DELETE /identity/v3/users/8e17a9b26c564fe3ad173068225de892 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:37.796296 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:37.796594 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:37.796878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:37.813092 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234e144-621b-4ace-a740-6af4be30e96c None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:37.818449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:37.820348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:37.882283 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eccc516e4354bd78f33c775d7f2ac58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:37.883035 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:37.883567 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:37.883923 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:37.885802 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:37.889370 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1348/2731] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:44:37.899536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:37.901591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:37.949422 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:37.951116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:37.959746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1384/2732] 10.222.0.65 () {60 vars in 1384 bytes} [Mon Feb 21 09:44:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:44:37.971908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a394-6216-446e-b9c9-94520fd66b67 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:37.976791 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:37.977449 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:37.977731 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:37.982395 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:37.987568 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:37.988994 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:37.998335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1349/2733] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:44:38.474500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:38.477817 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:38.517640 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b628e-98e7-4355-a7bd-d89ce7ad15ee service swift] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:38.529908 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:38.530788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:38.531071 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:38.531379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] PATH_INFO: `/v3/projects/fd7f2080257142b8b49d889ef4d2720c` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:38.534851 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7f2080257142b8b49d889ef4d2720c)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:38.536779 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:38.668840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7f2080257142b8b49d889ef4d2720c', 'request_id': 'req-f042e387-429a-4e06-931e-2ffe7d3a686c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:38.675804 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7f2080257142b8b49d889ef4d2720c', 'request_id': 'req-f042e387-429a-4e06-931e-2ffe7d3a686c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:38.682593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7f2080257142b8b49d889ef4d2720c', 'request_id': 'req-f042e387-429a-4e06-931e-2ffe7d3a686c'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:38.781979 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] The token cache is being invalidate because project fd7f2080257142b8b49d889ef4d2720c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:38.782278 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:38.786101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:38.786101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1385/2734] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:38 2022] DELETE /identity/v3/projects/fd7f2080257142b8b49d889ef4d2720c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:41.449883 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:41.451364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:41.465000 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e683ab4-d369-4bfe-bb0d-167ab0b5e470 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:41.520607 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:41.521974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:41.522257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:41.522530 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] PATH_INFO: `/v3/users/de11619d296943c0acc861426f06fab8` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:41.523840 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de11619d296943c0acc861426f06fab8)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:41.525767 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:41.873954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de11619d296943c0acc861426f06fab8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:41.880600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de11619d296943c0acc861426f06fab8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:41.975722 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de11619d296943c0acc861426f06fab8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:41.976341 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de11619d296943c0acc861426f06fab8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:41.976974 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8ddfd611-7627-4c02-a4cd-250e7f15d08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de11619d296943c0acc861426f06fab8'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:41.993497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1350/2735] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:41 2022] DELETE /identity/v3/users/de11619d296943c0acc861426f06fab8 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:42.272711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:42.274160 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:42.287846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042e387-429a-4e06-931e-2ffe7d3a686c admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:42.344527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:42.345313 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.345601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.345878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] PATH_INFO: `/v3/projects/8fbaf298b9674b85b243addfb4123c48` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.347062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fbaf298b9674b85b243addfb4123c48)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:42.348992 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:42.455013 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fbaf298b9674b85b243addfb4123c48', 'request_id': 'req-f8164827-5522-4a4e-8fad-15fc34796add'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:42.461130 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fbaf298b9674b85b243addfb4123c48', 'request_id': 'req-f8164827-5522-4a4e-8fad-15fc34796add'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:42.466665 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fbaf298b9674b85b243addfb4123c48', 'request_id': 'req-f8164827-5522-4a4e-8fad-15fc34796add'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:42.569331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] The token cache is being invalidate because project 8fbaf298b9674b85b243addfb4123c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:42.569626 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:42.570288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f8164827-5522-4a4e-8fad-15fc34796add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:42.571984 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1386/2736] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:42 2022] DELETE /identity/v3/projects/8fbaf298b9674b85b243addfb4123c48 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:42.576971 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.577473 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.577590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.595226 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:42.596384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:42.652028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1351/2737] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:42.659801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.660091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.660366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.679539 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:42.680740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:42.688637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1387/2738] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:42.692769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:42.702046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27783d0-005b-4aa0-9498-b63141da0c3b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:42.706537 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:42.707171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.707484 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.707758 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.708460 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:44:42.708763 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:42.710841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:42.721667 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1352/2739] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:44:42.726343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:42.735690 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bffff5-9c82-4fe6-b2d5-e0882248e546 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:42.740438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:42.741087 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.741377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.741659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.742378 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:42.744363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:42.879696 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1388/2740] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:42 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:42.883516 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:42.893866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d9bc3-670b-44c4-b4ad-124e05751ce9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:42.932250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:42.933970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:42.949430 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:42.950097 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.950383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.950659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.951384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:42.953336 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:42.990728 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388d0a-2b53-4b63-955d-ad5154052d93 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:42.994517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:42.995193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:42.995571 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:42.995845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:42.997606 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:43.010011 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:43.011477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:43.021085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1389/2741] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:44:43.056472 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1353/2742] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:42 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:43.060590 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:43.073240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfa80d-f761-456f-9e5b-f666917eeca1 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:43.079256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:43.080116 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:43.080405 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:43.080685 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:43.081449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:43.083517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:43.094196 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1390/2743] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:43.098079 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:43.108400 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdff8-cf35-4ec6-996e-8a13ce053b2b admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:43.112894 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:43.113550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:43.113835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:43.114110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:43.114831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:43.117028 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffb1cb-010d-4693-925a-4b90dc75ed26 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:43.126652 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1354/2744] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:43.130689 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:43.140687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40a7f-bb83-4f70-8c9e-0e1188d32544 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:43.145340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:43.146214 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:43.146525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:43.146803 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] PATH_INFO: `/v3/projects/bdec61399334468da5e336586f93deda/users/548a6f7a3c6246deb3f2adc6bfee751b/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:43.161603 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdec61399334468da5e336586f93deda, user_id=548a6f7a3c6246deb3f2adc6bfee751b, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:43.164848 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:43.262225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1391/2745] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:43 2022] PUT /identity/v3/projects/bdec61399334468da5e336586f93deda/users/548a6f7a3c6246deb3f2adc6bfee751b/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:43.272802 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:43.273091 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:43.273364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:43.298908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] MFA Rules not processed for user `548a6f7a3c6246deb3f2adc6bfee751b`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:43.300126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:43.372523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1355/2746] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:43.374551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:43.376814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:43.435827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25fa87-6a6f-41b5-a2ab-310abee080f1 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:43.439947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:43.440645 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:43.440952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:43.441261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:43.451020 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:43.452747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:43.462383 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1392/2747] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:46.556888 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:46.558983 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:46.624962 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce1fdc-67bf-4c42-b30c-1bb6dcd647e3 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:46.629670 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:46.630602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:46.630815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:46.631090 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] PATH_INFO: `/v3/users/765e2a7f731c4facbb94fe8117e0053c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:46.632429 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=765e2a7f731c4facbb94fe8117e0053c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:46.634319 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:46.838784 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765e2a7f731c4facbb94fe8117e0053c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:46.846383 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765e2a7f731c4facbb94fe8117e0053c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:46.922602 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765e2a7f731c4facbb94fe8117e0053c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:46.923456 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765e2a7f731c4facbb94fe8117e0053c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:46.924096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-f45ef507-8c49-4e05-bdac-f2990dacda3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765e2a7f731c4facbb94fe8117e0053c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:46.943057 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1356/2748] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:46 2022] DELETE /identity/v3/users/765e2a7f731c4facbb94fe8117e0053c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:47.166469 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.180336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f071-58bd-405b-a2a9-44ce79d9cd69 service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.237138 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.237997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.238290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.238569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] PATH_INFO: `/v3/projects/de0675c09376415bbbaab858235b8765` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.239854 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0675c09376415bbbaab858235b8765)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.242194 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.348403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0675c09376415bbbaab858235b8765', 'request_id': 'req-42feea3f-30f8-4b91-a437-fc288c260eff'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:47.355230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0675c09376415bbbaab858235b8765', 'request_id': 'req-42feea3f-30f8-4b91-a437-fc288c260eff'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:47.360998 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0675c09376415bbbaab858235b8765', 'request_id': 'req-42feea3f-30f8-4b91-a437-fc288c260eff'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:47.403975 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] The token cache is being invalidate because project de0675c09376415bbbaab858235b8765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:47.404269 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:47.410412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-42feea3f-30f8-4b91-a437-fc288c260eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:47.410412 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1393/2749] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:47 2022] DELETE /identity/v3/projects/de0675c09376415bbbaab858235b8765 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:47.412463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.412603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.412886 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.432137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:47.433347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:47.496969 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1357/2750] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:47.504938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.505230 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.505509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.524565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:47.529219 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:47.533549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1394/2751] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:47.537940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.548114 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71d1a-e100-41d1-9948-e425e54fb606 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.552690 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.553342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.553629 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.554467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.555192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:44:47.555554 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.557154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.568390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1358/2752] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:44:47.573370 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.583060 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacd977-5150-47de-ae5a-d601e7a951d7 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.588375 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.589021 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.589305 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.589577 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.590254 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.592199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.651725 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1395/2753] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:47 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:44:47.655789 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.665785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6212d99-9c78-4ced-bc8a-2efc838da6b6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.719435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.720096 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.720382 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.720660 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.721342 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.723242 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.800467 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1359/2754] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:47 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:47.808670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.818861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74ab26-f87d-46be-b905-f37069229757 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.823487 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.824136 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.824416 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.824691 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.825404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.826970 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.837030 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1396/2755] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:47.840978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.851248 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d481fa9-1590-4e6b-bcf3-e00b7db56caa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.855805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.856452 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.856739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.857020 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.857739 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.859344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a2be-43f7-4d12-9b96-b0b9cbbb87cf admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.870844 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1360/2756] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:47.874838 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:47.885243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a764be-34a9-4acf-9886-3015129efa22 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:47.890004 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:47.895104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.895104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.895104 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] PATH_INFO: `/v3/projects/4028a2faf6c04c8fbce17d51a2827338/users/071957b17f504ad8ac2a0acb61bda192/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:47.905695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4028a2faf6c04c8fbce17d51a2827338, user_id=071957b17f504ad8ac2a0acb61bda192, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:47.908411 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:47.981402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1397/2757] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:47 2022] PUT /identity/v3/projects/4028a2faf6c04c8fbce17d51a2827338/users/071957b17f504ad8ac2a0acb61bda192/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:47.992415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:47.992705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:47.992982 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.018103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] MFA Rules not processed for user `071957b17f504ad8ac2a0acb61bda192`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:48.019322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:48.080538 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1361/2758] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:44:48.085707 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.147268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa65f-2ab6-4830-8080-542e00c5c116 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.152532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.153185 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.153470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.153747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.154445 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.156371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.249468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1398/2759] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:44:48.253455 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.264346 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5762-1f3b-4c30-b410-f7bf084d57c6 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.317759 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.318415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.318699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.319002 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.320215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.322107 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.404518 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1362/2760] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:48 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:44:48.408357 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.420348 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89ac-c557-408a-b1dc-d61f73cb6e2d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.425724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.426973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.426973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.427167 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.427904 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.430560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.442093 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1399/2761] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:48.447755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.457881 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28cef3-0a69-4a70-b7ec-49bf80e4219e admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.463575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.464480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.464762 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.465043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] PATH_INFO: `/v3/projects/530c6f427da841e6a52008bed60f75e2/users/3e32003f78d940fc8953ad20c87e9f9d/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.481879 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530c6f427da841e6a52008bed60f75e2, user_id=3e32003f78d940fc8953ad20c87e9f9d, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.484519 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.558675 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1363/2762] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:48 2022] PUT /identity/v3/projects/530c6f427da841e6a52008bed60f75e2/users/3e32003f78d940fc8953ad20c87e9f9d/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:48.562560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.572869 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec993-369d-427c-b061-d67ecb2384f2 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.627671 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.628961 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.629267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.629527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.630246 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.632426 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab72d61-e574-46ed-9b49-9be30c72b5e9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.642026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1400/2763] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:48.646113 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.656913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1cca3-20bb-4d4d-8aa8-1862e085e8b6 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.662005 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.662980 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.663353 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.663703 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] PATH_INFO: `/v3/projects/530c6f427da841e6a52008bed60f75e2/users/3e32003f78d940fc8953ad20c87e9f9d/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.665800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530c6f427da841e6a52008bed60f75e2, user_id=3e32003f78d940fc8953ad20c87e9f9d, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.668457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.678575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1364/2764] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:48 2022] PUT /identity/v3/projects/530c6f427da841e6a52008bed60f75e2/users/3e32003f78d940fc8953ad20c87e9f9d/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:48.688935 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.689229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.689512 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.716244 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] MFA Rules not processed for user `3e32003f78d940fc8953ad20c87e9f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:48.717439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:48.785001 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1401/2765] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:48.800494 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:48.802291 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:48.858085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bbee5-77db-4582-bfdf-0bf694ecea66 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:48.861769 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:48.862414 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:48.862701 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:48.862979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:48.872207 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:48.873623 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fdf43-c630-4e6c-9693-aece0bcbbfdb service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:48.883249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1365/2766] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:49.758040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:49.822142 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb473510-5495-4b4b-bea4-58bf3b277da8 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:49.829841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:49.829841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:49.829841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:49.829841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] PATH_INFO: `/v3/users/071957b17f504ad8ac2a0acb61bda192` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:49.830237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=071957b17f504ad8ac2a0acb61bda192)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:49.832026 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:50.006404 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071957b17f504ad8ac2a0acb61bda192'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.013139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071957b17f504ad8ac2a0acb61bda192'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.071073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071957b17f504ad8ac2a0acb61bda192'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.071736 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071957b17f504ad8ac2a0acb61bda192'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.072356 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071957b17f504ad8ac2a0acb61bda192'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.090801 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1402/2767] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:49 2022] DELETE /identity/v3/users/071957b17f504ad8ac2a0acb61bda192 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:50.095483 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:50.095949 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:50.096181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:50.114272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:50.115523 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:50.173895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1366/2768] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:50.183972 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:50.185362 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:50.244394 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d20a8a-e0e1-435f-b83a-3874d0d6c79e admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:50.248252 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:50.248896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:50.249290 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:50.249578 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:50.259840 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:50.261594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:50.271541 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1403/2769] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:44:50.668685 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:50.670073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:50.681502 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda3bbc-ba2d-4c6c-9b92-32a41892b306 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:50.686522 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:50.687347 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:50.687636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:50.687920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] PATH_INFO: `/v3/projects/4028a2faf6c04c8fbce17d51a2827338` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:50.689471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4028a2faf6c04c8fbce17d51a2827338)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:50.691115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:50.798600 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4028a2faf6c04c8fbce17d51a2827338', 'request_id': 'req-6de4f992-ab6d-453c-8731-2bf3342190a3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.804714 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4028a2faf6c04c8fbce17d51a2827338', 'request_id': 'req-6de4f992-ab6d-453c-8731-2bf3342190a3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.810177 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4028a2faf6c04c8fbce17d51a2827338', 'request_id': 'req-6de4f992-ab6d-453c-8731-2bf3342190a3'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.889137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] The token cache is being invalidate because project 4028a2faf6c04c8fbce17d51a2827338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:50.889426 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.890055 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:50.891610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1367/2770] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:50 2022] DELETE /identity/v3/projects/4028a2faf6c04c8fbce17d51a2827338 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:50.895884 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:50.906511 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49db65-2659-4d4d-8d13-33d8e45b0a18 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:50.962845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:50.963732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:50.964017 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:50.964311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] PATH_INFO: `/v3/users/3e32003f78d940fc8953ad20c87e9f9d` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:50.965565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e32003f78d940fc8953ad20c87e9f9d)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:50.967517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:51.137091 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e32003f78d940fc8953ad20c87e9f9d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.143735 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e32003f78d940fc8953ad20c87e9f9d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.192649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e32003f78d940fc8953ad20c87e9f9d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.193280 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e32003f78d940fc8953ad20c87e9f9d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.193895 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a9d99a32-ba15-4e52-87c6-88fa224d57ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e32003f78d940fc8953ad20c87e9f9d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.212387 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1404/2771] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:50 2022] DELETE /identity/v3/users/3e32003f78d940fc8953ad20c87e9f9d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:51.613298 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:51.613298 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:51.626326 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4f992-ab6d-453c-8731-2bf3342190a3 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:51.682154 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:51.682998 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:51.683280 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:51.683581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] PATH_INFO: `/v3/projects/530c6f427da841e6a52008bed60f75e2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:51.684736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=530c6f427da841e6a52008bed60f75e2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:51.686610 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:51.809745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530c6f427da841e6a52008bed60f75e2', 'request_id': 'req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.815823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530c6f427da841e6a52008bed60f75e2', 'request_id': 'req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.821619 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530c6f427da841e6a52008bed60f75e2', 'request_id': 'req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.917770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] The token cache is being invalidate because project 530c6f427da841e6a52008bed60f75e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:51.918062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.918706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-8d83bf46-c76e-4c1d-a1d3-1da2d2c5b76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:51.920269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1368/2772] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:51 2022] DELETE /identity/v3/projects/530c6f427da841e6a52008bed60f75e2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:51.925168 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34828-f885-41dd-a482-73aa872d39af None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:51.925649 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34828-f885-41dd-a482-73aa872d39af None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:51.925770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff34828-f885-41dd-a482-73aa872d39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:51.942711 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-dff34828-f885-41dd-a482-73aa872d39af None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:51.943929 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-dff34828-f885-41dd-a482-73aa872d39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:52.001480 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1405/2773] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:52.015529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.015529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.015529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.027958 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:52.029171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:52.037618 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1369/2774] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:52.042548 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff34828-f885-41dd-a482-73aa872d39af None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.052439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff34828-f885-41dd-a482-73aa872d39af None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.057250 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.057945 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.058232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.058517 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.059243 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:44:52.059601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.061262 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.073294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1406/2775] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:44:52.077574 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.087185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736ad88-30cd-4572-b117-167cead9a5d8 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.091902 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.092601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.092824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.093103 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.093787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.095709 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.194110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1370/2776] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:52.198478 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.208538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42451d7b-b1a3-4008-947c-37ab930266b3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.263263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.263956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.264245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.264527 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.265208 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.267198 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.385041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1407/2777] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:52.389482 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.399749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334cab-e23c-4419-9b43-362dd5216053 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.404490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.405144 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.405431 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.405710 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.406427 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.408185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.419712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1371/2778] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:52.423669 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.433926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd8fb8-ff2f-4836-92b0-894f1ec13e92 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.438553 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.439193 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.439637 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.439918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.440700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.442223 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62228dcc-5a60-4c65-bd5a-d149acccbfab admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.452082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1408/2779] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:52.456240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.466451 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40efe-52c2-4c8f-b290-895a5d6cf4db admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.471007 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.471901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.472185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.472457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] PATH_INFO: `/v3/projects/315b6f3e863d4031b7618a6b1dd54764/users/8cf6b3d7cfa0469ea36691eecc93e025/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.486717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315b6f3e863d4031b7618a6b1dd54764, user_id=8cf6b3d7cfa0469ea36691eecc93e025, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.489495 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.570704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1372/2780] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:52 2022] PUT /identity/v3/projects/315b6f3e863d4031b7618a6b1dd54764/users/8cf6b3d7cfa0469ea36691eecc93e025/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:52.582225 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.582530 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.582815 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.608758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] MFA Rules not processed for user `8cf6b3d7cfa0469ea36691eecc93e025`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:52.609969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:52.671746 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1409/2781] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:52.676159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.737964 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba63e5-f6b5-4dde-a71a-b421a3ca4ec4 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.742614 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.743268 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.743586 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.743866 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] PATH_INFO: `/v3/projects` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.744589 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.746581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:52.850901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1373/2782] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:52.855139 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:52.865704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06bc89-ec73-49a9-8702-0d1f63d9ec2a None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:52.919921 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:52.920589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:52.920878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:52.921158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:52.921839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:52.923788 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.010119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1410/2783] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:52 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:53.014232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.024898 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac4ecc-71c2-464e-922e-f212b536204c admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.029539 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.030185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.030474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.030796 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.031481 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.033059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.043322 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1374/2784] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:53.047588 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.057698 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e5e6-6a37-41ed-a335-d1f386d48fd7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.062544 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.063464 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.066402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.066402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] PATH_INFO: `/v3/projects/19119d1463784611bb7b989dc4f4ed9e/users/11c9e888fc3e46f8aab7ac3f0d2a1435/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.079406 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19119d1463784611bb7b989dc4f4ed9e, user_id=11c9e888fc3e46f8aab7ac3f0d2a1435, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.082188 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.180560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1411/2785] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:53 2022] PUT /identity/v3/projects/19119d1463784611bb7b989dc4f4ed9e/users/11c9e888fc3e46f8aab7ac3f0d2a1435/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:53.184591 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.195445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be747d86-5b39-4ed4-a122-1f1adfd07833 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.248576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.249240 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.249525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.249803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.250514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.252143 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112719-e1e5-4312-a99c-9f6141980ab6 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.262054 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1375/2786] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:53.266433 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.277747 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a514-2ce7-41dd-8fee-7bea6d676986 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.282615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.283555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.283839 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.284224 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] PATH_INFO: `/v3/projects/19119d1463784611bb7b989dc4f4ed9e/users/11c9e888fc3e46f8aab7ac3f0d2a1435/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.286341 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19119d1463784611bb7b989dc4f4ed9e, user_id=11c9e888fc3e46f8aab7ac3f0d2a1435, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.289073 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.299807 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1412/2787] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:53 2022] PUT /identity/v3/projects/19119d1463784611bb7b989dc4f4ed9e/users/11c9e888fc3e46f8aab7ac3f0d2a1435/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:53.310628 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.310973 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.311255 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.338486 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] MFA Rules not processed for user `11c9e888fc3e46f8aab7ac3f0d2a1435`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:53.339736 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:53.404575 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1376/2788] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:53.414947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.416695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:53.471656 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5a23-f2c3-45af-a381-0d06ce437752 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.475251 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.475918 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.476207 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.476492 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.485271 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.486695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd45990-23e2-4415-a946-7eb188d97b68 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:53.496413 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1413/2789] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:53.839265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:53.902529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca224c-e241-4dbc-8dc2-68922a0400c2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:53.910147 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:53.911349 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:53.911638 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:53.911914 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] PATH_INFO: `/v3/users/8cf6b3d7cfa0469ea36691eecc93e025` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:53.913636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf6b3d7cfa0469ea36691eecc93e025)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:53.915646 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:54.108182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf6b3d7cfa0469ea36691eecc93e025'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.114601 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf6b3d7cfa0469ea36691eecc93e025'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.192374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf6b3d7cfa0469ea36691eecc93e025'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.192999 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf6b3d7cfa0469ea36691eecc93e025'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.193612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf6b3d7cfa0469ea36691eecc93e025'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.211438 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1377/2790] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:53 2022] DELETE /identity/v3/users/8cf6b3d7cfa0469ea36691eecc93e025 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:54.216108 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.216573 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.216800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.235552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:54.236761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.295376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1414/2791] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:44:54.305159 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:54.306595 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.354944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:54.356489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.363560 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96914-9691-42b4-8938-abf997185825 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:54.367954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:54.368604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.368785 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c905e-8070-4c31-9633-1e746eb1a997 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:54.368895 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.369156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.373340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:54.374195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.374483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.374761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] PATH_INFO: `/v3/users/548a6f7a3c6246deb3f2adc6bfee751b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.376414 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548a6f7a3c6246deb3f2adc6bfee751b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:54.377886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:54.378256 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:54.379754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6b76a-5048-4adc-87cf-fad7c55d5a86 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:54.389648 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1378/2792] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:44:54.601350 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548a6f7a3c6246deb3f2adc6bfee751b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.608533 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548a6f7a3c6246deb3f2adc6bfee751b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.678331 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548a6f7a3c6246deb3f2adc6bfee751b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.679598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548a6f7a3c6246deb3f2adc6bfee751b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.680210 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548a6f7a3c6246deb3f2adc6bfee751b'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.698334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1415/2793] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:54 2022] DELETE /identity/v3/users/548a6f7a3c6246deb3f2adc6bfee751b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:54.702752 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.703044 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.703339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.720072 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:54.721265 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.777384 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1379/2794] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:54.787284 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:54.789300 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.805712 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:54.807553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:54.820920 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a7597-b997-435f-8c89-1a1ebe561c08 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:54.825987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:54.826851 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.827140 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.827469 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] PATH_INFO: `/v3/projects/315b6f3e863d4031b7618a6b1dd54764` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.828659 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315b6f3e863d4031b7618a6b1dd54764)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:54.830651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:54.856865 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b83b-55ab-4dd4-bd00-ea22ec036e81 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:54.860519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:54.861175 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:54.861462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:54.861738 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:54.871081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:54.872773 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:54.882311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1416/2795] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:54.939356 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315b6f3e863d4031b7618a6b1dd54764', 'request_id': 'req-e249ee78-d5ce-45da-887e-3cf21eea2a73'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.945415 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315b6f3e863d4031b7618a6b1dd54764', 'request_id': 'req-e249ee78-d5ce-45da-887e-3cf21eea2a73'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:54.950745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315b6f3e863d4031b7618a6b1dd54764', 'request_id': 'req-e249ee78-d5ce-45da-887e-3cf21eea2a73'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.020562 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] The token cache is being invalidate because project 315b6f3e863d4031b7618a6b1dd54764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:55.020860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.021525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.023704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1380/2796] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:54 2022] DELETE /identity/v3/projects/315b6f3e863d4031b7618a6b1dd54764 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:55.027732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:55.037758 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d19ff-9230-4fda-8287-7d5f801db59e service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:55.095038 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:55.095960 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:55.096234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:55.096510 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] PATH_INFO: `/v3/users/11c9e888fc3e46f8aab7ac3f0d2a1435` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:55.097744 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c9e888fc3e46f8aab7ac3f0d2a1435)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:55.099719 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:55.275597 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c9e888fc3e46f8aab7ac3f0d2a1435'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.281935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:55.285914 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c9e888fc3e46f8aab7ac3f0d2a1435'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.286137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:55.302604 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249ee78-d5ce-45da-887e-3cf21eea2a73 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:55.307390 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:55.308321 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:55.311441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:55.311441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] PATH_INFO: `/v3/projects/bdec61399334468da5e336586f93deda` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:55.311441 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdec61399334468da5e336586f93deda)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:55.312476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:55.356524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c9e888fc3e46f8aab7ac3f0d2a1435'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.357209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c9e888fc3e46f8aab7ac3f0d2a1435'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.357833 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c9e888fc3e46f8aab7ac3f0d2a1435'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.376117 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1417/2797] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:44:55 2022] DELETE /identity/v3/users/11c9e888fc3e46f8aab7ac3f0d2a1435 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:55.454606 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdec61399334468da5e336586f93deda', 'request_id': 'req-22843ddc-c4c4-4d8f-be67-2239eb186949'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.460961 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdec61399334468da5e336586f93deda', 'request_id': 'req-22843ddc-c4c4-4d8f-be67-2239eb186949'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.466504 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdec61399334468da5e336586f93deda', 'request_id': 'req-22843ddc-c4c4-4d8f-be67-2239eb186949'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.598981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] The token cache is being invalidate because project bdec61399334468da5e336586f93deda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:55.599142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.599862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-22843ddc-c4c4-4d8f-be67-2239eb186949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:55.605704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1381/2798] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:55 2022] DELETE /identity/v3/projects/bdec61399334468da5e336586f93deda => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:55.799763 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:55.801398 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:55.871078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671888fe-6f5f-4282-a9f6-9cb4cfb82241 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:55.924714 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:55.925561 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:55.925846 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:55.926135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] PATH_INFO: `/v3/projects/19119d1463784611bb7b989dc4f4ed9e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:55.927367 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19119d1463784611bb7b989dc4f4ed9e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:55.929376 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.053494 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19119d1463784611bb7b989dc4f4ed9e', 'request_id': 'req-88db4bfd-922a-4af6-892f-a82749de0af8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:56.060083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19119d1463784611bb7b989dc4f4ed9e', 'request_id': 'req-88db4bfd-922a-4af6-892f-a82749de0af8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:56.065470 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19119d1463784611bb7b989dc4f4ed9e', 'request_id': 'req-88db4bfd-922a-4af6-892f-a82749de0af8'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:56.132449 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] The token cache is being invalidate because project 19119d1463784611bb7b989dc4f4ed9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:44:56.132741 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:56.133391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-88db4bfd-922a-4af6-892f-a82749de0af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:44:56.134944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1418/2799] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:44:55 2022] DELETE /identity/v3/projects/19119d1463784611bb7b989dc4f4ed9e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:56.140040 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.140498 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.143375 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.158363 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:56.159850 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:56.216458 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1382/2800] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:56.224363 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.224659 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.224944 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.243264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:56.244481 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:56.252296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1419/2801] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:56.256339 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.265507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfd3e5-04fb-4649-9403-f07437545e26 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.270115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.270800 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.271110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.271569 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.272945 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:44:56.273297 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.275149 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.286344 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1383/2802] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:44:56.291066 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.304103 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbdbc-659e-47f2-98bf-82af9c299248 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.308641 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.309287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.309565 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.309837 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.310525 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.312442 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.391861 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1420/2803] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:44:56.396087 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.406237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b7e96-ed94-414f-9480-afecbf78245f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.458885 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.459580 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.460378 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.460656 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.461348 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.463247 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.648862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1384/2804] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:56.652897 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.663366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898278-61c9-4123-87b9-25fce42093f8 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.668075 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.668740 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.669027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.669306 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.670062 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.671701 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.681951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1421/2805] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:56.685812 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.696137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d719f-be85-474e-9322-8ddc6570b071 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.700634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.701272 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.701553 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.701821 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.702559 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.704165 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fa1f2-e94f-4af9-bba6-aafbb0083a09 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.714201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1385/2806] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:56.718164 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.728037 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8be9a-4f7e-4646-8ac5-dd54ff4ed6e6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.732509 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.733366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.733652 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.733930 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] PATH_INFO: `/v3/projects/3c991589817d48bc94cad1e3c4e3dc96/users/12c039cc583649ceb690d68a0f2506ea/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.747759 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c991589817d48bc94cad1e3c4e3dc96, user_id=12c039cc583649ceb690d68a0f2506ea, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.750371 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:56.812925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1422/2807] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:56 2022] PUT /identity/v3/projects/3c991589817d48bc94cad1e3c4e3dc96/users/12c039cc583649ceb690d68a0f2506ea/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:56.824827 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.825116 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.825393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.851845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] MFA Rules not processed for user `12c039cc583649ceb690d68a0f2506ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:56.853067 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:56.914181 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1386/2808] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:56.918601 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:56.978521 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd78b-a341-4d02-812e-b539dd114dd7 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:56.983319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:56.984039 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:56.984330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:56.984610 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:56.985292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:56.987183 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.072111 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1423/2809] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:44:56 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:57.076274 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.086775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b10a5-7fda-49b3-9212-5dfdc2cdacec None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.140954 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.141585 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.141823 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.142135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.142814 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.144755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.213273 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1387/2810] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:44:57 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:44:57.217161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.227236 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f364a-b0b2-4700-bb04-e8df5ff50eb3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.231873 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.232514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.232798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.233074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.233787 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.235391 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.246529 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1424/2811] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:44:57.250440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.261161 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c42e4-d127-4838-b272-4425db7fdc12 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.265772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.266694 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.266978 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.267254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] PATH_INFO: `/v3/projects/9e52ac99f3c24ed6807409de392b9071/users/c5ad6b1b447f4758b932c3f943ca8206/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.281476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e52ac99f3c24ed6807409de392b9071, user_id=c5ad6b1b447f4758b932c3f943ca8206, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.284185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.351358 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1388/2812] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:57 2022] PUT /identity/v3/projects/9e52ac99f3c24ed6807409de392b9071/users/c5ad6b1b447f4758b932c3f943ca8206/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:44:57.355318 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.365403 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76834-7c72-465e-91fd-6b2ad37338c3 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.419282 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.419907 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.420189 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.420488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.421199 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.422806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b9e1-c4bd-4c57-bd69-c3da45a4f03b admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.432636 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1425/2813] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 09:44:57.436658 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.446676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece7e8-6fdc-4411-afed-98967e0d8642 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.451217 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.452115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.452401 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.452679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] PATH_INFO: `/v3/projects/9e52ac99f3c24ed6807409de392b9071/users/c5ad6b1b447f4758b932c3f943ca8206/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.454662 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e52ac99f3c24ed6807409de392b9071, user_id=c5ad6b1b447f4758b932c3f943ca8206, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.457292 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.467377 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1389/2814] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:44:57 2022] PUT /identity/v3/projects/9e52ac99f3c24ed6807409de392b9071/users/c5ad6b1b447f4758b932c3f943ca8206/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:44:57.477819 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.478118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.478402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.505625 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] MFA Rules not processed for user `c5ad6b1b447f4758b932c3f943ca8206`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:44:57.506853 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:57.576842 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1426/2815] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:44:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:44:57.583517 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.585276 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:44:57.640755 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edce33-3f96-4fa6-a857-6c571f2155d9 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.644497 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.645130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.645417 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.645699 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.655084 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.656542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.666016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1390/2816] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:44:57.753154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:44:57.763360 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a5692-1ef3-49f0-abc6-c34f00608300 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:44:57.767119 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:44:57.767810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:44:57.768097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:44:57.768380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:44:57.823805 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:44:57.825237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b9d94-9305-47a2-9219-8117a0d1d096 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:44:57.834022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1427/2817] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:44:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:00.854889 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:00.920578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fe771-6804-48b0-9b8b-5ccede4ed343 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:00.925229 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:00.926176 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:00.926463 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:00.926745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] PATH_INFO: `/v3/users/12c039cc583649ceb690d68a0f2506ea` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:00.928018 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c039cc583649ceb690d68a0f2506ea)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:00.930013 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:01.148612 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c039cc583649ceb690d68a0f2506ea'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.155457 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c039cc583649ceb690d68a0f2506ea'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.209535 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c039cc583649ceb690d68a0f2506ea'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.210692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c039cc583649ceb690d68a0f2506ea'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.211331 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c039cc583649ceb690d68a0f2506ea'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.228184 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1391/2818] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:00 2022] DELETE /identity/v3/users/12c039cc583649ceb690d68a0f2506ea => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:01.235154 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:01.235687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:01.235798 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:01.252569 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:01.253757 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:01.309952 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1428/2819] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:45:01.320059 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:01.321474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:01.375706 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cd324-5626-4806-ae88-fda0ca0a24fa admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:01.379214 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:01.379882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:01.380168 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:01.380450 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:01.389832 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:01.391254 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:01.401022 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1392/2820] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:01.797878 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:01.799381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:01.811574 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592517f5-f62c-4a91-b32c-171f230f3feb None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:01.816330 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:01.817200 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:01.817499 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:01.817858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] PATH_INFO: `/v3/projects/3c991589817d48bc94cad1e3c4e3dc96` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:01.819634 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c991589817d48bc94cad1e3c4e3dc96)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:01.821456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:01.945938 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c991589817d48bc94cad1e3c4e3dc96', 'request_id': 'req-f0d67ea4-745f-4362-901e-9eece89abb4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.952211 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c991589817d48bc94cad1e3c4e3dc96', 'request_id': 'req-f0d67ea4-745f-4362-901e-9eece89abb4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:01.957795 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c991589817d48bc94cad1e3c4e3dc96', 'request_id': 'req-f0d67ea4-745f-4362-901e-9eece89abb4f'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.042812 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] The token cache is being invalidate because project 3c991589817d48bc94cad1e3c4e3dc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:02.043110 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.043794 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.045338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1429/2821] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:01 2022] DELETE /identity/v3/projects/3c991589817d48bc94cad1e3c4e3dc96 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:02.057046 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:02.066717 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc501c1-55fb-4f26-be02-f13cd02e6037 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:02.121371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:02.122224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:02.122507 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:02.122780 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] PATH_INFO: `/v3/users/c5ad6b1b447f4758b932c3f943ca8206` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:02.123979 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ad6b1b447f4758b932c3f943ca8206)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:02.125863 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:02.278908 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ad6b1b447f4758b932c3f943ca8206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.285860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ad6b1b447f4758b932c3f943ca8206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.327480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ad6b1b447f4758b932c3f943ca8206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.328275 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ad6b1b447f4758b932c3f943ca8206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.329060 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-74a662b2-9213-4bf4-ad5b-a5a6fd0813a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ad6b1b447f4758b932c3f943ca8206'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.347380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1393/2822] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:02 2022] DELETE /identity/v3/users/c5ad6b1b447f4758b932c3f943ca8206 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:02.765390 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:02.766943 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:02.781336 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d67ea4-745f-4362-901e-9eece89abb4f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:02.837439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:02.838268 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:02.838552 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:02.838828 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] PATH_INFO: `/v3/projects/9e52ac99f3c24ed6807409de392b9071` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:02.840041 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e52ac99f3c24ed6807409de392b9071)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:02.841947 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:02.973085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e52ac99f3c24ed6807409de392b9071', 'request_id': 'req-f19898d1-ba7d-45cb-bb25-bb763739712d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.979215 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e52ac99f3c24ed6807409de392b9071', 'request_id': 'req-f19898d1-ba7d-45cb-bb25-bb763739712d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:02.984551 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e52ac99f3c24ed6807409de392b9071', 'request_id': 'req-f19898d1-ba7d-45cb-bb25-bb763739712d'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:03.078097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] The token cache is being invalidate because project 9e52ac99f3c24ed6807409de392b9071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:03.078299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:03.078951 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-f19898d1-ba7d-45cb-bb25-bb763739712d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:03.080666 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1430/2823] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:02 2022] DELETE /identity/v3/projects/9e52ac99f3c24ed6807409de392b9071 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:03.085590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.086092 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.086223 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.103770 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:03.104993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:03.162330 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1394/2824] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:03.170314 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.170615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.170919 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.189456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:03.190648 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:03.199118 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1431/2825] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:03.203080 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.212397 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c200-11cf-4afb-bdf8-67414cf63fba None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.216940 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.219364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.219364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.219364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.219364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:45:03.219364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.220741 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.231916 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1395/2826] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:45:03.236080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.245770 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1ba00-728f-418f-967f-c5dbfe69a1b0 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.250520 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.251161 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.251475 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.251753 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.252538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.254410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.336080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1432/2827] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:45:03.344338 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.355026 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230b8-fc82-4007-824f-22c70f874380 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.411824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.412480 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.413258 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.413547 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.414224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.416160 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.478043 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1396/2828] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:45:03.482239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.493133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912260c7-f1a6-45ff-9941-501ff73918dd admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.497881 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.498532 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.498820 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.499135 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.499896 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.501496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.511825 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1433/2829] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:03.516227 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.526237 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eae209-5c44-4090-9400-c90c6eaa25be admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.530921 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.531615 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.531905 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.532182 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.532904 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.534493 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eb30a-658f-40b6-b1b0-44128d965a54 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.545145 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1397/2830] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:03.549217 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.559542 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ab16c-5d2f-4fb2-9422-9e946ae12b65 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.564259 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.565125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.565410 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.565687 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] PATH_INFO: `/v3/projects/b3c033f81dff45f5a6563566cb1d613b/users/7790e4603dc54dabb812de6b11eeea47/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.582102 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c033f81dff45f5a6563566cb1d613b, user_id=7790e4603dc54dabb812de6b11eeea47, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.584810 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.671775 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1434/2831] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:45:03 2022] PUT /identity/v3/projects/b3c033f81dff45f5a6563566cb1d613b/users/7790e4603dc54dabb812de6b11eeea47/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:45:03.683773 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.684073 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.684359 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.710514 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] MFA Rules not processed for user `7790e4603dc54dabb812de6b11eeea47`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:03.711862 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:03.772860 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1398/2832] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:03.777287 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.836566 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1820-795d-44ff-9cfc-219c7c5a7b69 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:03.841233 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:03.841886 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:03.842176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:03.842457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:03.843184 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:03.845133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:03.936624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1435/2833] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:45:03.940778 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:03.951869 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f58c92-22ad-415b-96d8-3dd07a1f96b0 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.006232 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.006906 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.007192 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.007500 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.008228 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.010142 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.105138 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1399/2834] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:45:03 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:45:04.109157 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:04.119401 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f536ca-dae7-419e-8659-682e575f38f9 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.124112 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.124761 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.125063 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.125343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.126061 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.127674 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.138427 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1436/2835] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:04.142425 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:04.152745 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0a286-aa47-4e0d-944b-7392e8bc0061 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.157402 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.158267 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.158552 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.158829 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] PATH_INFO: `/v3/projects/e1a7cddea414423ab446876eaa02942b/users/70dbe79c88da479498a07dffc1c8006c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.173234 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a7cddea414423ab446876eaa02942b, user_id=70dbe79c88da479498a07dffc1c8006c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.175915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.273327 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1400/2836] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:45:04 2022] PUT /identity/v3/projects/e1a7cddea414423ab446876eaa02942b/users/70dbe79c88da479498a07dffc1c8006c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:04.277245 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:04.287624 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c4842-f675-4477-952e-0f99c327abba admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.342289 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.342948 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.343232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.343536 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.344248 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.345841 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6961a8-51e1-4306-a156-ec1758f39d2e admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.355710 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1437/2837] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:04.359915 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:04.370001 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db9a42-2e2a-4a3f-a8cd-974abcad8a9f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.374669 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.375581 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.375865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.376135 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] PATH_INFO: `/v3/projects/e1a7cddea414423ab446876eaa02942b/users/70dbe79c88da479498a07dffc1c8006c/roles/df7e26fc5ae142e6b88e95bef3637384` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.378075 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a7cddea414423ab446876eaa02942b, user_id=70dbe79c88da479498a07dffc1c8006c, role_id=df7e26fc5ae142e6b88e95bef3637384)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.380728 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.391131 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1401/2838] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:45:04 2022] PUT /identity/v3/projects/e1a7cddea414423ab446876eaa02942b/users/70dbe79c88da479498a07dffc1c8006c/roles/df7e26fc5ae142e6b88e95bef3637384 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:45:04.401776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.402078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.402361 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.428034 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] MFA Rules not processed for user `70dbe79c88da479498a07dffc1c8006c`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:04.429790 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:04.495128 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1438/2839] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:45:04.504550 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:04.506215 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:04.561859 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259d97-69bc-4051-be75-3c738a251bf0 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:04.565542 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:04.566186 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:04.566475 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:04.566785 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:04.621880 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:04.623388 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:04.632213 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1402/2840] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:45:09.651704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:09.653106 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:09.665670 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd27c57-8fdf-4cca-843d-2423b1a0b218 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:09.669171 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:09.669799 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:09.670081 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:09.670351 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:09.679467 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:09.680859 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16f879-fd37-491f-b574-56b2238a54e4 service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:09.689926 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1439/2841] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:15.582570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:15.643269 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eade-cd78-4fad-a329-ac680b75ea4d service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:15.648672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:15.649534 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:15.649842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:15.650115 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] PATH_INFO: `/v3/users/7790e4603dc54dabb812de6b11eeea47` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:15.651366 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7790e4603dc54dabb812de6b11eeea47)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:15.653420 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:15.810775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7790e4603dc54dabb812de6b11eeea47'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:15.817490 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7790e4603dc54dabb812de6b11eeea47'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:15.872503 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7790e4603dc54dabb812de6b11eeea47'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:15.873133 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7790e4603dc54dabb812de6b11eeea47'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:15.873753 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7790e4603dc54dabb812de6b11eeea47'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:15.890903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1403/2842] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:15 2022] DELETE /identity/v3/users/7790e4603dc54dabb812de6b11eeea47 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:15.895419 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:15.895956 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:15.896074 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:15.914518 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:15.915742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:15.972776 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1440/2843] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:15.982878 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:15.987194 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:16.040418 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7fe37-cc80-43ca-a039-6fd4a89e42bd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:16.044137 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:16.044790 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:16.045085 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:16.045368 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:16.054333 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:16.055803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:16.064963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1404/2844] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:16.460444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:16.466723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:16.474299 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91809d-8a4f-427e-ab6d-f99da0f92e4b None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:16.479027 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:16.479925 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:16.480229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:16.480524 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] PATH_INFO: `/v3/projects/b3c033f81dff45f5a6563566cb1d613b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:16.481800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c033f81dff45f5a6563566cb1d613b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:16.483732 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:16.597660 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c033f81dff45f5a6563566cb1d613b', 'request_id': 'req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.603786 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c033f81dff45f5a6563566cb1d613b', 'request_id': 'req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.609155 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c033f81dff45f5a6563566cb1d613b', 'request_id': 'req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.683176 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] The token cache is being invalidate because project b3c033f81dff45f5a6563566cb1d613b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:16.683500 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.684125 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.685650 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1441/2845] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:16 2022] DELETE /identity/v3/projects/b3c033f81dff45f5a6563566cb1d613b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:16.689586 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:16.699578 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108e80d-83a4-4ffe-835f-07f1d8b985b7 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:16.752094 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:16.752913 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:16.753201 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:16.753471 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] PATH_INFO: `/v3/users/70dbe79c88da479498a07dffc1c8006c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:16.754647 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dbe79c88da479498a07dffc1c8006c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:16.757221 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:16.953824 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dbe79c88da479498a07dffc1c8006c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:16.960369 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dbe79c88da479498a07dffc1c8006c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.064603 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dbe79c88da479498a07dffc1c8006c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.065156 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dbe79c88da479498a07dffc1c8006c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.065777 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-caa0978a-60fc-42a3-9a54-42c51627de50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dbe79c88da479498a07dffc1c8006c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.082679 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1405/2846] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:16 2022] DELETE /identity/v3/users/70dbe79c88da479498a07dffc1c8006c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:17.494906 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:17.496380 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:17.509120 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1e14-8e9f-4cf3-a0e7-75c421a99016 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:17.564589 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:17.565438 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:17.565723 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:17.565995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] PATH_INFO: `/v3/projects/e1a7cddea414423ab446876eaa02942b` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:17.567177 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a7cddea414423ab446876eaa02942b)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:17.569621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:17.707178 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a7cddea414423ab446876eaa02942b', 'request_id': 'req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.713700 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a7cddea414423ab446876eaa02942b', 'request_id': 'req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.719058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a7cddea414423ab446876eaa02942b', 'request_id': 'req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.791267 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] The token cache is being invalidate because project e1a7cddea414423ab446876eaa02942b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:17.791593 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.792216 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-fea6a62a-2ad6-4464-a26a-8e25c0c1c4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:17.793809 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1442/2847] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:17 2022] DELETE /identity/v3/projects/e1a7cddea414423ab446876eaa02942b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:17.800901 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:17.801389 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:17.801499 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:17.819422 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:17.820826 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:17.876582 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1406/2848] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:17.886424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:17.886716 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:17.886995 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:17.905234 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:17.906477 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:17.914488 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1443/2849] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:17.918510 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:17.928815 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c237f-ab42-47ba-b2f3-5bd9f2f9e642 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:17.933386 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:17.935208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:17.935208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:17.935208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:17.935536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:45:17.935636 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:17.937130 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:17.948948 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1407/2850] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Feb 21 09:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:45:17.953343 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:17.962240 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244059-b8cb-4173-87a2-0121f0c3c7fa None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:17.966793 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:17.967461 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:17.967789 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:17.968069 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] PATH_INFO: `/v3/projects` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:17.968752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:17.970621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.048866 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1444/2851] 10.222.0.65 () {60 vars in 1152 bytes} [Mon Feb 21 09:45:17 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:45:18.052632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:18.062899 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63dac8-1855-4d5d-ad40-af1c55b34b74 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:18.115454 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:18.116732 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.117023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.117303 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] PATH_INFO: `/v3/users` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.117993 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:18.119937 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.191950 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1408/2852] 10.222.0.65 () {60 vars in 1143 bytes} [Mon Feb 21 09:45:18 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:45:18.196598 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:18.206662 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644683-74cc-41c9-8c49-19aa402b1892 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:18.211334 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:18.211980 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.212319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.212555 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] PATH_INFO: `/v3/roles` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.213277 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:18.214868 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.225057 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1445/2853] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:18.228882 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:18.238676 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b3159-ed31-427c-8376-b9eb732a8cdd admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:18.243807 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:18.244433 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.244713 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.244988 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.245705 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:18.247277 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441851d-c749-404c-8054-f2cf243acf0a admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.257787 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1409/2854] 10.222.0.65 () {58 vars in 1121 bytes} [Mon Feb 21 09:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:45:18.261629 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:18.271425 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7737-2071-45d5-a6f6-d81c10dd276f admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:18.276209 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992e79-d047-4a56-b497-a087367727de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:18.277080 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992e79-d047-4a56-b497-a087367727de admin admin] REQUEST_METHOD: `PUT` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.277366 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992e79-d047-4a56-b497-a087367727de admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.277642 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77992e79-d047-4a56-b497-a087367727de admin admin] PATH_INFO: `/v3/projects/18c4101fdc274ebbabd30ec038ba441d/users/08c340d8849a4f5e9c5379e6d27b23de/roles/588f5e2f6b5c466bafbf0fe06ec211aa` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.292621 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992e79-d047-4a56-b497-a087367727de admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c4101fdc274ebbabd30ec038ba441d, user_id=08c340d8849a4f5e9c5379e6d27b23de, role_id=588f5e2f6b5c466bafbf0fe06ec211aa)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:18.295237 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77992e79-d047-4a56-b497-a087367727de admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.389814 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1446/2855] 10.222.0.65 () {60 vars in 1482 bytes} [Mon Feb 21 09:45:18 2022] PUT /identity/v3/projects/18c4101fdc274ebbabd30ec038ba441d/users/08c340d8849a4f5e9c5379e6d27b23de/roles/588f5e2f6b5c466bafbf0fe06ec211aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:18.394775 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b62d-7006-40ff-9521-082945421dc7 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.395069 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b62d-7006-40ff-9521-082945421dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.395380 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b62d-7006-40ff-9521-082945421dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.413476 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-a4a4b62d-7006-40ff-9521-082945421dc7 None None] MFA Rules not processed for user `1dd6f1c3379444b8bbd64274c9643ace`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:18.414641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a4a4b62d-7006-40ff-9521-082945421dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:18.468772 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1410/2856] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:18.478592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992e79-d047-4a56-b497-a087367727de admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:18.480298 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-77992e79-d047-4a56-b497-a087367727de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:18.540437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77992e79-d047-4a56-b497-a087367727de admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:18.544256 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:18.544901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:18.545182 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:18.545456 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:18.554969 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:18.556431 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:18.565439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1447/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:19.828224 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855768-1e97-44e1-a608-7f8bcc376006 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:19.828751 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855768-1e97-44e1-a608-7f8bcc376006 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:19.828868 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2855768-1e97-44e1-a608-7f8bcc376006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:19.855991 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-c2855768-1e97-44e1-a608-7f8bcc376006 None None] MFA Rules not processed for user `08c340d8849a4f5e9c5379e6d27b23de`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:19.857238 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-c2855768-1e97-44e1-a608-7f8bcc376006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:19.920171 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1411/2858] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:19.929973 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:19.931468 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:19.987083 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984887d-e89f-46b1-b1e0-a0a7ce2eca67 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:19.991822 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:19.992463 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:19.992752 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:19.993036 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:20.001133 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:20.002564 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:20.011695 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1448/2859] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:21.709062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:21.709593 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:21.709692 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:21.726597 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] MFA Rules not processed for user `08c340d8849a4f5e9c5379e6d27b23de`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:45:21.727836 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:21.734711 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1412/2860] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:45:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:45:23.724834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:23.726806 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:23.794124 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e3216-28fc-4835-be2c-1826dc4a18cc service cinder] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:23.799353 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:23.800002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:23.800292 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:23.800615 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:23.802386 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:23.814153 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:23.815755 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:23.825902 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1449/2861] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:30.425212 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:30.426671 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:30.439045 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea532a0-96da-467f-bcfa-954c0a554b0b None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:30.442673 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:30.443337 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:30.443632 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:30.444448 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:30.446225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:30.503023 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:30.504512 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:30.514506 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1413/2862] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:38.238221 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:38.248255 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd385-ae72-416e-8422-f2c86eb5e70f service placement] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:38.252257 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:38.252997 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:38.253288 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:38.253570 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:38.255379 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:38.268957 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:38.270402 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:38.280190 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1450/2863] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:45:46.464890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:46.466419 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:46.484110 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed569c7-1048-4c7c-8d38-da837d986839 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:46.488968 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:46.496987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:46.496987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:46.496987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] PATH_INFO: `/v3/users/1c577c166b4b4419be1494e34800a710` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:46.496987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c577c166b4b4419be1494e34800a710)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:46.496987 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:46.713064 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c577c166b4b4419be1494e34800a710'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:46.719776 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c577c166b4b4419be1494e34800a710'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:46.807146 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c577c166b4b4419be1494e34800a710'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:46.807820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c577c166b4b4419be1494e34800a710'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:46.808532 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c577c166b4b4419be1494e34800a710'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:46.831541 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1414/2864] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:46 2022] DELETE /identity/v3/users/1c577c166b4b4419be1494e34800a710 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:47.142239 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:47.153201 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32722d-ba0f-4c88-be69-48e4bc3328e5 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:47.210058 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:47.210916 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:47.211204 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:47.211514 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] PATH_INFO: `/v3/projects/c1bcb57c2e244aceb2ca6d49b3276d7e` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:47.212704 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1bcb57c2e244aceb2ca6d49b3276d7e)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:47.214643 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:47.337203 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1bcb57c2e244aceb2ca6d49b3276d7e', 'request_id': 'req-a569e73b-a829-4326-bcfb-1f9bc84dc046'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.343232 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1bcb57c2e244aceb2ca6d49b3276d7e', 'request_id': 'req-a569e73b-a829-4326-bcfb-1f9bc84dc046'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.348587 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1bcb57c2e244aceb2ca6d49b3276d7e', 'request_id': 'req-a569e73b-a829-4326-bcfb-1f9bc84dc046'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.437040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] The token cache is being invalidate because project c1bcb57c2e244aceb2ca6d49b3276d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:47.437264 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.437903 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.439484 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1451/2865] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:47 2022] DELETE /identity/v3/projects/c1bcb57c2e244aceb2ca6d49b3276d7e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:47.444095 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:47.445525 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:47.458399 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c08f-06e7-41ef-a58b-dc770a41ef92 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:47.513841 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:47.514704 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:47.514989 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:47.515264 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] PATH_INFO: `/v3/users/12e5e9c2bb4242d29b3037253c2e942c` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:47.516536 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e5e9c2bb4242d29b3037253c2e942c)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:47.518440 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:47.756820 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e5e9c2bb4242d29b3037253c2e942c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.763529 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e5e9c2bb4242d29b3037253c2e942c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.881651 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e5e9c2bb4242d29b3037253c2e942c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.882289 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e5e9c2bb4242d29b3037253c2e942c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.882903 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e5e9c2bb4242d29b3037253c2e942c'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:47.900513 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1415/2866] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:45:47 2022] DELETE /identity/v3/users/12e5e9c2bb4242d29b3037253c2e942c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:45:48.164966 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:45:48.166457 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:45:48.182520 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569e73b-a829-4326-bcfb-1f9bc84dc046 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:45:48.236502 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:45:48.237338 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:45:48.237618 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:45:48.237890 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] PATH_INFO: `/v3/projects/a609c79e763d4c52a143bee7d875d8bc` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:45:48.239082 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a609c79e763d4c52a143bee7d875d8bc)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:45:48.241065 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:45:48.356816 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a609c79e763d4c52a143bee7d875d8bc', 'request_id': 'req-2dbe47b0-c384-44b3-a5d2-1a68c3315522'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:48.363022 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a609c79e763d4c52a143bee7d875d8bc', 'request_id': 'req-2dbe47b0-c384-44b3-a5d2-1a68c3315522'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:48.368439 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a609c79e763d4c52a143bee7d875d8bc', 'request_id': 'req-2dbe47b0-c384-44b3-a5d2-1a68c3315522'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:48.457377 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] The token cache is being invalidate because project a609c79e763d4c52a143bee7d875d8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79600) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:45:48.457668 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:48.458296 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-2dbe47b0-c384-44b3-a5d2-1a68c3315522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:45:48.460482 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1452/2867] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:45:48 2022] DELETE /identity/v3/projects/a609c79e763d4c52a143bee7d875d8bc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:46:03.000412 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:46:03.001733 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:03.067570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914436-e12d-44da-9903-eab8ea822286 admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:46:03.115439 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:46:03.116083 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:46:03.116367 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:46:03.116643 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:46:03.118443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:03.175393 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:46:03.176831 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8bb01-3278-4d4b-bd1c-99ed00ff94e9 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:46:03.185620 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1416/2868] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:46:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:46:18.978519 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] REQUEST_METHOD: `POST` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:46:18.979085 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:46:18.979195 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:46:18.996323 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.auth.core [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] MFA Rules not processed for user `abb204e5377544b09ceb754b8a9bd072`. Rule list: `[]` (Enabled: `True`). {{(pid=79600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:46:18.997534 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:19.004261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1453/2869] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:46:39.658198 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] REQUEST_METHOD: `POST` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:46:39.658674 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:46:39.658803 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:46:39.676754 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.auth.core [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] MFA Rules not processed for user `08c340d8849a4f5e9c5379e6d27b23de`. Rule list: `[]` (Enabled: `True`). {{(pid=79601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:46:39.677935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:39.729511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1417/2870] 10.222.0.65 () {58 vars in 957 bytes} [Mon Feb 21 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:46:44.817354 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:46:44.819325 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:44.874983 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa1a7-22af-4253-9721-af432f2f35b9 None None] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:46:44.878706 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:46:44.879384 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:46:44.879677 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:46:44.879964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:46:44.882285 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:46:44.948078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:46:44.949462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:46:44.959025 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1454/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:46:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:47:12.802231 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:47:12.803794 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:12.815435 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e3d82-8940-4a6a-bc91-11b44490fee2 None None] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:47:12.820208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8225ba8ede944425a2b21bb4eeb8ec10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:47:12.820208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:47:12.820208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:47:12.820208 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:47:12.821873 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:12.891216 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:47:12.892672 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:47:12.904306 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1418/2872] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:47:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:47:16.936845 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:47:16.938319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:16.952261 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6abcb-4335-4c1e-a0c2-53b09fb72b21 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:47:16.966594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:47:16.966594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:47:16.966594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:47:16.966594 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:47:16.967012 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:16.977489 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:47:16.978996 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:47:16.991920 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1455/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:47:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:47:18.172564 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:47:18.174122 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:18.188845 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cc825-2b6a-448b-8feb-02cd2000ebc6 service cinder] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:47:18.194445 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7eb5c189bbd41449e3478b7dfcb27fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:47:18.195124 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:47:18.195443 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:47:18.195721 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:47:18.197496 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:18.211315 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:47:18.212936 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:47:18.223590 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1419/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:47:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:47:46.815857 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:47:46.817317 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:47:46.879894 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361127-40fe-49b9-ac0e-9333c644d65d service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:47:46.884462 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:47:46.885311 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:47:46.885591 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:47:46.885863 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] PATH_INFO: `/v3/users/08c340d8849a4f5e9c5379e6d27b23de` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:47:46.887040 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c340d8849a4f5e9c5379e6d27b23de)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:47:46.889014 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:47:47.123631 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c340d8849a4f5e9c5379e6d27b23de'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.130580 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c340d8849a4f5e9c5379e6d27b23de'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.249538 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c340d8849a4f5e9c5379e6d27b23de'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.250158 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c340d8849a4f5e9c5379e6d27b23de'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.250800 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c340d8849a4f5e9c5379e6d27b23de'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.268560 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1456/2875] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:47:46 2022] DELETE /identity/v3/users/08c340d8849a4f5e9c5379e6d27b23de => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:47:47.535362 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:47:47.547287 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b4c5-f27f-456e-b62a-eab69829b1cf service nova] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:47:47.602943 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:47:47.603805 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:47:47.604093 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:47:47.604374 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] PATH_INFO: `/v3/projects/18c4101fdc274ebbabd30ec038ba441d` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:47:47.605558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c4101fdc274ebbabd30ec038ba441d)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:47:47.607474 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:47:47.821152 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c4101fdc274ebbabd30ec038ba441d', 'request_id': 'req-cbacde09-9d5f-4e52-9282-7c925c007a2f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.827016 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c4101fdc274ebbabd30ec038ba441d', 'request_id': 'req-cbacde09-9d5f-4e52-9282-7c925c007a2f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.832249 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c4101fdc274ebbabd30ec038ba441d', 'request_id': 'req-cbacde09-9d5f-4e52-9282-7c925c007a2f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.904335 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] The token cache is being invalidate because project 18c4101fdc274ebbabd30ec038ba441d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:47:47.904627 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.905257 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:47:47.906798 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1420/2876] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:47:47 2022] DELETE /identity/v3/projects/18c4101fdc274ebbabd30ec038ba441d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:48:10.607279 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:10.608784 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:10.666294 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1070778-15d1-4d10-b2e0-50e3cbe27c06 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:10.713949 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:10.714592 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:10.714874 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:10.715149 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:10.716962 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:10.726444 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:10.727901 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:10.735605 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1457/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:48:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:48:41.517565 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:41.518981 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:41.579588 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacde09-9d5f-4e52-9282-7c925c007a2f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:41.583193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3db3df5c19dd4331a2c85d3a10bcb0f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:41.583865 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:41.584172 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:41.584444 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:41.586185 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:41.676206 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:41.677570 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:41.687749 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1421/2878] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:48:49.249381 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:49.250964 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:49.299340 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ed1c-775f-4442-8155-1f10d583f207 service neutron] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:49.304002 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:49.304858 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:49.305145 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:49.305424 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] PATH_INFO: `/v3/users/abb204e5377544b09ceb754b8a9bd072` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:49.306623 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb204e5377544b09ceb754b8a9bd072)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:49.308576 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:49.467596 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb204e5377544b09ceb754b8a9bd072'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:49.474152 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb204e5377544b09ceb754b8a9bd072'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:49.562742 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb204e5377544b09ceb754b8a9bd072'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:49.563319 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb204e5377544b09ceb754b8a9bd072'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:49.563967 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb204e5377544b09ceb754b8a9bd072'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:49.582303 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1458/2879] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:48:49 2022] DELETE /identity/v3/users/abb204e5377544b09ceb754b8a9bd072 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:48:49.883202 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:49.916193 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ca445-68d4-4199-8361-66f0a4c25bc3 service neutron] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:49.969890 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:49.971031 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:49.971350 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:49.971634 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] PATH_INFO: `/v3/projects/b11ed249505a4004b9ac29e6e0d515ff` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:49.972842 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11ed249505a4004b9ac29e6e0d515ff)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:49.974792 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:50.103225 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11ed249505a4004b9ac29e6e0d515ff', 'request_id': 'req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.109835 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11ed249505a4004b9ac29e6e0d515ff', 'request_id': 'req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.115015 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11ed249505a4004b9ac29e6e0d515ff', 'request_id': 'req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.200311 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] The token cache is being invalidate because project b11ed249505a4004b9ac29e6e0d515ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:48:50.200511 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.201126 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.202641 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1422/2880] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:48:49 2022] DELETE /identity/v3/projects/b11ed249505a4004b9ac29e6e0d515ff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:48:50.206683 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:50.216523 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:50.221078 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1e9c-2e7e-4706-a541-31ac18b0dd6d admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:50.274836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:50.275724 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:50.276008 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:50.276286 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] PATH_INFO: `/v3/users/261bd85a933e476381cf915ce665db68` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:50.277496 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=261bd85a933e476381cf915ce665db68)` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:50.279434 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:50.455437 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261bd85a933e476381cf915ce665db68'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.462097 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261bd85a933e476381cf915ce665db68'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.532852 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261bd85a933e476381cf915ce665db68'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.533483 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261bd85a933e476381cf915ce665db68'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.534101 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.notifications [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261bd85a933e476381cf915ce665db68'} {{(pid=79600) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:50.552094 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1459/2881] 10.222.0.65 () {58 vars in 1223 bytes} [Mon Feb 21 09:48:50 2022] DELETE /identity/v3/users/261bd85a933e476381cf915ce665db68 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:48:50.787715 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Authenticating user token {{(pid=79601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:48:50.803986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.fernet_utils [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:48:50.803986 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd9f5e-5b6c-4fb5-8fbb-b36ab37ea25f admin admin] Validating token access rules against request {{(pid=79601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:48:50.858876 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dd6f1c3379444b8bbd64274c9643ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3f01046c2f74fba94104e65299e171f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:48:50.859771 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:48:50.860062 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:48:50.860371 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] PATH_INFO: `/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2` {{(pid=79601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:48:50.861558 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ccdb6f99e4a4de3a13689f10ec2c9f2)` {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:48:50.863555 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] RBAC: Authorization granted {{(pid=79601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:48:50.996963 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ccdb6f99e4a4de3a13689f10ec2c9f2', 'request_id': 'req-80a6cfd2-5686-445a-b63e-9cf49c69d688'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:51.003364 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ccdb6f99e4a4de3a13689f10ec2c9f2', 'request_id': 'req-80a6cfd2-5686-445a-b63e-9cf49c69d688'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:51.008644 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ccdb6f99e4a4de3a13689f10ec2c9f2', 'request_id': 'req-80a6cfd2-5686-445a-b63e-9cf49c69d688'} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:51.132639 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] The token cache is being invalidate because project 0ccdb6f99e4a4de3a13689f10ec2c9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 09:48:51.132935 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:51.133576 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: DEBUG keystone.notifications [None req-80a6cfd2-5686-445a-b63e-9cf49c69d688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 09:48:51.135167 dv-cinder-778193-19-iscsi devstack@keystone.service[79601]: [pid: 79601|app: 0|req: 1423/2882] 10.222.0.65 () {58 vars in 1232 bytes} [Mon Feb 21 09:48:50 2022] DELETE /identity/v3/projects/0ccdb6f99e4a4de3a13689f10ec2c9f2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:51:07.856836 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Authenticating user token {{(pid=79600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:51:07.858263 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:51:07.965900 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98617b4f-7844-4fc4-a081-71abc933eef6 admin admin] Validating token access rules against request {{(pid=79600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:51:08.035876 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50283131637940ae9445c1800a8abb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0871a61b4c9c4295b0e5aab04fcb5619', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:51:08.036549 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] REQUEST_METHOD: `GET` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:51:08.036834 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] SCRIPT_NAME: `/identity` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:51:08.037109 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:51:08.038899 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.fernet_utils [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:51:08.050229 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:51:08.051827 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0161-e3be-4a1e-8b7b-1774c1a226ab service placement] RBAC: Authorization granted {{(pid=79600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:51:08.061344 dv-cinder-778193-19-iscsi devstack@keystone.service[79600]: [pid: 79600|app: 0|req: 1460/2883] 10.222.0.65 () {60 vars in 1365 bytes} [Mon Feb 21 09:51:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)